Apr 29 08:28:39 devstack cinder-volume[75229]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:28:39 devstack cinder-volume[75229]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:28:39 devstack cinder-volume[75229]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:28:40 devstack cinder-volume[75229]: INFO dbcounter [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Registered counter for database cinder
Apr 29 08:28:40 devstack cinder-volume[75229]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:40 devstack cinder-volume[75229]: DEBUG dbcounter [-] [75229] Writer thread running {{(pid=75229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:28:40 devstack cinder-volume[75229]: INFO cinder.rpc [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 08:28:40 devstack cinder-volume[75229]: INFO cinder.rpc [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 08:28:40 devstack cinder-volume[75229]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:41 devstack cinder-volume[75229]: INFO cinder.volume.manager [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Determined volume DB was empty at startup.
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75229) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 08:28:41 devstack cinder-volume[75229]: INFO cinder.volume.manager [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 29 08:28:41 devstack cinder-volume[75229]: WARNING stevedore.named [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 08:28:41 devstack cinder-volume[75229]: WARNING castellan.key_manager [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:28:41 devstack cinder-volume[75229]: WARNING cinder.keymgr.conf_key_mgr [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG cinder.volume.drivers.lvm [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75229) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] CMD "cinder-rtstool verify" returned: 0 in 0.417s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:41 devstack cinder-volume[75229]: INFO cinder.rpc [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 29 08:28:41 devstack cinder-volume[75229]: INFO cinder.rpc [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 29 08:28:41 devstack cinder-volume[75229]: WARNING stevedore.named [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 08:28:41 devstack cinder-volume[75229]: WARNING castellan.key_manager [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:28:41 devstack cinder-volume[75229]: INFO cinder.volume.manager [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:41 devstack cinder-volume[75229]: INFO oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Starting 1 workers
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Started child 75400 {{(pid=75229) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Full set of CONF: {{(pid=75229) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] ******************************************************************************** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Configuration options gathered from: {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] ================================================================================ {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 08:28:41 devstack cinder-volume[75400]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0)
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] allow_availability_zone_fallback = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] allow_compression_on_image_upload = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] allowed_direct_url_schemes     = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] api_rate_limit                 = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] auth_strategy                  = keystone {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] az_cache_duration              = 3600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_availability_zone      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_host                   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_name                   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_stats_polling_interval = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backup_api_class               = cinder.backup.api.API {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backup_name_template           = backup-%s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backup_use_same_host           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backup_use_temp_snapshot       = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] chap_password                  = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] chap_username                  =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cinder_internal_tenant_project_id = 3c578a205f9a4248b59555df754409d5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cinder_internal_tenant_user_id = 447b297519a84588a10326a302e927f1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cloned_volume_same_az          = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cluster                        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] compression_format             = gzip {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] config_dir                     = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] config_source                  = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] control_exchange               = openstack {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] debug                          = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] default_availability_zone      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] default_group_type             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] default_volume_type            = lvmdriver-1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] disk_geometry                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] driver_client_cert             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] driver_client_cert_key         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] driver_data_namespace          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] driver_ssl_cert_path           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] driver_ssl_cert_verify         = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] driver_use_ssl                 = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] enable_force_upload            = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] enable_new_services            = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] enable_unsupported_driver      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] enforce_multipath_for_image_xfer = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] filter_function                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_api_insecure            = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_api_servers             = ['http://192.168.122.243/image'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_api_ssl_compression     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_ca_certificates_file    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_certfile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_keyfile                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_num_retries             = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance_request_timeout         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] goodness_function              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] graceful_shutdown_timeout      = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] group_api_class                = cinder.group.api.API {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] host                           = devstack {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_compress_on_upload       = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75400]: INFO cinder.volume.manager [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_conversion_address_space_limit = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_conversion_cpu_limit     = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_conversion_disable       = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_upload_use_cinder_backend = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_upload_use_internal_tenant = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_volume_cache_enabled     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_volume_cache_max_count   = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] image_volume_cache_max_size_gb = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] init_host_max_objects_retrieval = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] iscsi_target_flags             =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] iscsi_write_cache              = on {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] iser_helper                    = tgtadm {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] iser_ip_address                = 192.168.122.243 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] iser_port                      = 3260 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] log_color                      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] log_config_append              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] log_dir                        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] log_file                       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] log_options                    = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] log_rotate_interval            = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] log_rotate_interval_type       = days {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] log_rotation_type              = none {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack sudo[75405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] max_age                        = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] max_logfile_count              = 30 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] max_logfile_size_mb            = 200 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack sudo[75405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] max_over_subscription_ratio    = 20.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] message_reap_interval          = 86400 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] message_ttl                    = 2592000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] migration_create_volume_timeout_secs = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] monkey_patch                   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] monkey_patch_modules           = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] my_ip                          = 192.168.122.243 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] no_snapshot_gb_quota           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] num_iser_scan_tries            = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] num_shell_tries                = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] num_volume_device_scan_tries   = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] nvmeof_conn_info_version       = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] nvmet_ns_id                    = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] nvmet_port_id                  = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] osapi_max_limit                = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] osapi_volume_ext_list          = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] osapi_volume_listen_port       = 8776 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] osapi_volume_use_ssl           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] osapi_volume_workers           = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] per_volume_size_limit          = -1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] periodic_fuzzy_delay           = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] periodic_interval              = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] public_endpoint                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] publish_errors                 = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] quota_backup_gigabytes         = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] quota_backups                  = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] quota_gigabytes                = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] quota_groups                   = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] quota_snapshots                = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:41 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] quota_volumes                  = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] rate_limit_burst               = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] rate_limit_except_level        = CRITICAL {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] rate_limit_interval            = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] reinit_driver_count            = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] replication_device             = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] report_discard_supported       = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] report_interval                = 120 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] reservation_clean_interval     = 86400 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] reservation_expire             = 86400 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] reserved_image_namespaces      = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] reserved_percentage            = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] rpc_response_timeout           = 120 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] run_external_periodic_tasks    = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] scst_target_driver             = iscsi {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] scst_target_iqn_name           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_down_time              = 720 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] shell_completion               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] snapshot_name_template         = snapshot-%s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] snapshot_same_host             = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] split_loggers                  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] state_path                     = /opt/stack/data/cinder {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] storage_availability_zone      = nova {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] storage_protocol               = iSCSI {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] syslog_log_facility            = LOG_USER {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] target_helper                  = lioadm {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] target_ip_address              = 192.168.122.243 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] target_port                    = 3260 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] target_protocol                = iscsi {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] target_secondary_ip_addresses  = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] trace_flags                    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] transport_url                  = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] until_refresh                  = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] use_chap_auth                  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] use_default_quota_class        = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] use_journal                    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] use_json                       = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] use_multipath_for_image_xfer   = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] use_stderr                     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] use_syslog                     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] verify_glance_signatures       = enabled {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_api_class               = cinder.volume.api.API {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_backend_name            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_clear                   = zero {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_clear_ionice            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_clear_size              = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_copy_bps_limit          = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_dd_blocksize            = 1M {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_name_template           = volume-%s {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_service_inithost_offload = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volume_usage_audit_period      = month {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] zoning_mode                    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_concurrency.disable_process_locking = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.admin_password = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.admin_token = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.admin_user  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.auth_protocol = https {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.auth_section = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.auth_type   = password {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.auth_uri    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.auth_version = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:42 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.cache       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.certfile    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.identity_uri = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.include_service_catalog = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.insecure    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.interface   = public {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.keyfile     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_password =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcache_username =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.region_name = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.service_type = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.243/identity {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.backend                  = dogpile.cache.null {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.backend_argument         = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.backend_expiration_time  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.config_prefix            = cache.oslo {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.debug_cache_backend      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.enable_retry_client      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.enable_socket_keepalive  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.enabled                  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.enforce_fips_mode        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.expiration_time          = 600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.hashclient_retry_attempts = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.memcache_dead_retry      = 300 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.memcache_sasl_enabled    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.password                 = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.proxies                  = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.redis_db                 = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.redis_server             = localhost:6379 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.retry_attempts           = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.retry_delay              = 0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.socket_keepalive_count   = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.socket_keepalive_idle    = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.socket_keepalive_interval = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.socket_timeout           = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.tls_allowed_ciphers      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.tls_cafile               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.tls_certfile             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.tls_enabled              = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.tls_keyfile              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cache.username                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] coordination.backend_url       = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.asyncio_connection    = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.asyncio_slave_connection = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.backend               = sqlalchemy {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.connection            = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.connection_debug      = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.connection_parameters =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.connection_recycle_time = 3600 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.connection_trace      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.db_inc_retry_interval = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.db_max_retries        = 20 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.db_max_retry_interval = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.db_retry_interval     = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.max_overflow          = 50 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.max_pool_size         = 5 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.max_retries           = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.mysql_wsrep_sync_wait = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.pool_timeout          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.retry_interval        = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.slave_connection      = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.sqlite_synchronous    = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.synchronous_reader    = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] database.use_db_reconnect      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.connection_string     = messaging:// {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.enabled               = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.es_doc_type           = notification {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.es_scroll_size        = 10000 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.es_scroll_time        = 2m {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.filter_error_trace    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.hmac_keys             = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.sentinel_service_name = mymaster {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.socket_timeout        = 0.1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.trace_requests        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler.trace_sqlalchemy      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler_jaeger.process_tags   = {} {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler_jaeger.service_name_prefix = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] profiler_otlp.service_name_prefix = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.enforce_new_defaults = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: WARNING oslo_config.cfg [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.enforce_scope      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.policy_default_rule = default {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] privsep_osbrick.group          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] privsep_osbrick.helper_command = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] privsep_osbrick.user           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cinder_sys_admin.group         = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cinder_sys_admin.helper_command = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] cinder_sys_admin.user          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.auth_section      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.auth_type         = password {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.cafile            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.certfile          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.collect_timing    = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.insecure          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.keyfile           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.send_service_user_token = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.split_loggers     = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] service_user.timeout           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.auth_section            = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.auth_type               = password {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.certfile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.collect_timing          = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.insecure                = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.keyfile                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.region_name             = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.split_loggers           = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] glance.timeout                 = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.backend_availability_zone = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.chap_password = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.chap_username =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.disk_geometry = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.driver_client_cert = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.driver_client_cert_key = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.driver_data_namespace = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.driver_use_ssl = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.extra_capabilities = {} {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.filter_function = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.goodness_function = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.iscsi_target_flags =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.iscsi_write_cache = on {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.iser_ip_address = 192.168.122.243 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.iser_port     = 3260 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.lvm_share_target = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.lvm_type      = auto {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.num_shell_tries = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.replication_device = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.report_discard_supported = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.reserved_percentage = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.target_helper = tgtadm {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.target_ip_address = 192.168.122.243 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.target_port   = 3260 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.target_protocol = iscsi {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.trace_flags   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.unique_fqdn_network = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.use_chap_auth = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volume_backend_name = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volume_clear  = zero {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volume_clear_ionice = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volume_clear_size = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_reports.file_event_handler = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_reports.log_dir           = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.backend_host       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.chap_password      = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.chap_username      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.disk_geometry      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.driver_client_cert = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.extra_capabilities = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.filter_function    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.goodness_function  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.iser_helper        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.iser_port          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.lvm_type           = auto {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.replication_device = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.report_discard_supported = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.reserved_percentage = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.scst_target_driver = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.storage_protocol   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.target_ip_address  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.target_port        = 3260 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.trace_flags        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volume_clear       = zero {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] lvmdriver-1.volumes_dir        = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_notifications.driver = [] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_notifications.retry = -1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] key_manager.fixed_key          = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.barbican_api_version  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.barbican_endpoint     = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.barbican_endpoint_type = public {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.barbican_region_name  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.cafile                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.certfile              = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.collect_timing        = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.insecure              = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.keyfile               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.number_of_retries     = 60 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.retry_delay           = 1 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.send_service_user_token = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.split_loggers         = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.timeout               = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.verify_ssl            = True {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican.verify_ssl_path       = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican_service_user.auth_section = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican_service_user.auth_type = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican_service_user.cafile   = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican_service_user.certfile = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican_service_user.collect_timing = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican_service_user.insecure = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican_service_user.keyfile  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican_service_user.split_loggers = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] barbican_service_user.timeout  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.approle_role_id          = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.approle_secret_id        = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.kv_mountpoint            = secret {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.kv_path                  = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.kv_version               = 2 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.namespace                = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.root_token_id            = **** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.ssl_ca_crt_file          = None {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.timeout                  = 60.0 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.use_ssl                  = False {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:42 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] ******************************************************************************** {{(pid=75229) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 08:28:42 devstack sudo[75405]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:42 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.889s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:42 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:42 devstack sudo[75416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:42 devstack sudo[75416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:43 devstack sudo[75416]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:43 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.596s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:43 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:28:43 devstack cinder-volume[75400]: INFO cinder.brick.local_dev.lvm [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 29 08:28:43 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:43 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:43 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:43 devstack sudo[75629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:43 devstack sudo[75629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:43 devstack sudo[75629]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:43 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:43 devstack cinder-volume[75400]: DEBUG cinder.brick.local_dev.lvm [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75400) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 29 08:28:43 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:43 devstack sudo[75831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:43 devstack sudo[75831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:45 devstack sudo[75831]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:45 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.776s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:45 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:45 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:45 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:45 devstack sudo[76152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:45 devstack sudo[76152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:46 devstack sudo[76152]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:46 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.671s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:46 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:46 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:46 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:46 devstack sudo[76184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 29 08:28:46 devstack sudo[76184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:47 devstack sudo[76184]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:47 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.678s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:47 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:47 devstack sudo[76187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:47 devstack sudo[76187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:47 devstack sudo[76187]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:47 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:47 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:47 devstack sudo[76192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:47 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:48 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:48 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:48 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:48 devstack sudo[76195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:48 devstack sudo[76195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:49 devstack sudo[76195]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:49 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:49 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:49 devstack sudo[76203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:49 devstack sudo[76203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:49 devstack sudo[76203]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:49 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.709s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:49 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:49 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:49 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:49 devstack sudo[76208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:49 devstack sudo[76208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:50 devstack sudo[76208]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:50 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.727s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:50 devstack cinder-volume[75400]: INFO cinder.volume.drivers.lvm [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 29 08:28:50 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:50 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:50 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:50 devstack sudo[76215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:50 devstack sudo[76215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:51 devstack sudo[76215]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:51 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.867s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:51 devstack cinder-volume[75400]: DEBUG cinder.volume.drivers.lvm [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Updating volume stats {{(pid=75400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:28:51 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:51 devstack sudo[76331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:51 devstack sudo[76331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:51 devstack cinder-volume[75229]: DEBUG dbcounter [-] [75229] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:28:52 devstack sudo[76331]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:52 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.727s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:52 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:52 devstack sudo[76464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:52 devstack sudo[76464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:52 devstack sudo[76464]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:52 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:52 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:52 devstack sudo[76479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:52 devstack sudo[76479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:53 devstack sudo[76479]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:53 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:53 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:53 devstack sudo[76483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:53 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:54 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:54 devstack cinder-volume[75400]: INFO cinder.volume.driver [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG cinder.volume.driver [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75400) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG oslo_db.sqlalchemy.engines [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75400) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG dbcounter [-] [75400] Writer thread running {{(pid=75400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG cinder.db.sqlalchemy.api [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Building query based on filter {{(pid=75400) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG cinder.image.image_utils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75400) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 08:28:54 devstack cinder-volume[75400]: INFO cinder.keymgr.migration [None req-225b6762-2eef-4093-950a-6232ac37ea7a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG cinder.volume.drivers.lvm [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Updating volume stats {{(pid=75400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:54 devstack sudo[76487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:54 devstack sudo[76487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:54 devstack sudo[76487]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.581s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:54 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:54 devstack sudo[76490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:54 devstack sudo[76490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:55 devstack sudo[76490]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:55 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:55 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:55 devstack sudo[76493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:55 devstack sudo[76493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:56 devstack sudo[76493]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:56 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.677s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:56 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:56 devstack sudo[76499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:56 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:56 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:56 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:56 devstack cinder-volume[75400]: DEBUG cinder.manager [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Notifying Schedulers of capabilities ... {{(pid=75400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:28:56 devstack cinder-volume[75400]: INFO cinder.volume.manager [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Driver initialization completed successfully.
Apr 29 08:28:56 devstack cinder-volume[75400]: INFO cinder.manager [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Initiating service 2 cleanup
Apr 29 08:28:56 devstack cinder-volume[75400]: INFO cinder.manager [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Service 2 cleanup completed.
Apr 29 08:28:56 devstack cinder-volume[75400]: DEBUG cinder.service [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Creating RPC server for service cinder-volume {{(pid=75400) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 08:28:56 devstack cinder-volume[75400]: DEBUG cinder.service [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75400) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 08:28:56 devstack cinder-volume[75400]: INFO cinder.volume.manager [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 29 08:28:56 devstack cinder-volume[75400]: DEBUG cinder.volume.drivers.lvm [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Updating volume stats {{(pid=75400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:28:56 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:56 devstack sudo[76503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:56 devstack sudo[76503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:57 devstack sudo[76503]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:57 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:57 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:57 devstack sudo[76507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:57 devstack sudo[76507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:58 devstack sudo[76507]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:58 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:58 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:58 devstack sudo[76510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:58 devstack sudo[76510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:58 devstack sudo[76510]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:58 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:58 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:58 devstack sudo[76571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:58 devstack sudo[76571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:59 devstack sudo[76571]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:59 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:59 devstack cinder-volume[75400]: INFO cinder.volume.manager [None req-ca0f55ad-dc8e-4d44-aa3a-c57d27ef151e None None] Driver post RPC initialization completed successfully.
Apr 29 08:29:09 devstack cinder-volume[75400]: DEBUG dbcounter [-] [75400] Writing DB stats cinder:SELECT=3 {{(pid=75400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:29:09 devstack cinder-volume[75400]: DEBUG dbcounter [-] [75400] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:30:26 devstack cinder-volume[75400]: DEBUG oslo_service.periodic_task [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:30:26 devstack cinder-volume[75400]: DEBUG cinder.volume.drivers.lvm [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Updating volume stats {{(pid=75400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:30:26 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:30:26 devstack sudo[81281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:30:26 devstack sudo[81281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:30:27 devstack sudo[81281]: pam_unix(sudo:session): session closed for user root
Apr 29 08:30:27 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:30:27 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:30:27 devstack sudo[81284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:30:27 devstack sudo[81284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:30:27 devstack sudo[81284]: pam_unix(sudo:session): session closed for user root
Apr 29 08:30:27 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:30:27 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:30:27 devstack sudo[81287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:30:27 devstack sudo[81287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:30:28 devstack sudo[81287]: pam_unix(sudo:session): session closed for user root
Apr 29 08:30:28 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:30:28 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:30:28 devstack sudo[81290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:30:28 devstack sudo[81290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:30:28 devstack sudo[81290]: pam_unix(sudo:session): session closed for user root
Apr 29 08:30:28 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:30:28 devstack cinder-volume[75400]: DEBUG cinder.manager [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Notifying Schedulers of capabilities ... {{(pid=75400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:31:09 devstack cinder-volume[75400]: DEBUG dbcounter [-] [75400] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:31:26 devstack cinder-volume[75400]: DEBUG oslo_service.periodic_task [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:31:26 devstack cinder-volume[75400]: DEBUG cinder.volume.drivers.lvm [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Updating volume stats {{(pid=75400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:31:26 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:26 devstack sudo[81785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:31:26 devstack sudo[81785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:27 devstack sudo[81785]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:27 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:27 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:27 devstack sudo[81793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:31:27 devstack sudo[81793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:27 devstack sudo[81793]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:27 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:27 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:27 devstack sudo[81796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:31:27 devstack sudo[81796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:28 devstack sudo[81796]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:28 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.576s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:28 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:28 devstack sudo[81799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:31:28 devstack sudo[81799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:28 devstack sudo[81799]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:28 devstack cinder-volume[75400]: DEBUG oslo_concurrency.processutils [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=75400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:28 devstack cinder-volume[75400]: DEBUG cinder.manager [None req-a41a2e8f-7cb4-4710-ac73-b45d3ea2b582 None None] Notifying Schedulers of capabilities ... {{(pid=75400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:31:43 devstack cinder-volume[75229]: INFO oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Caught SIGTERM, stopping children
Apr 29 08:31:43 devstack cinder-volume[75229]: DEBUG oslo_concurrency.lockutils [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Acquiring lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:43 devstack cinder-volume[75229]: DEBUG oslo_concurrency.lockutils [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Acquired lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:43 devstack cinder-volume[75229]: DEBUG oslo_concurrency.lockutils [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Releasing lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:43 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Stop services. {{(pid=75229) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 29 08:31:43 devstack cinder-volume[75229]: DEBUG oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Killing children. {{(pid=75229) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 29 08:31:43 devstack cinder-volume[75229]: INFO oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Waiting on 1 children to exit
Apr 29 08:31:46 devstack cinder-volume[75400]: DEBUG oslo_concurrency.lockutils [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Acquiring lock "singleton_lock" {{(pid=75400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:46 devstack cinder-volume[75400]: DEBUG oslo_concurrency.lockutils [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Acquired lock "singleton_lock" {{(pid=75400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:46 devstack cinder-volume[75400]: DEBUG oslo_concurrency.lockutils [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Releasing lock "singleton_lock" {{(pid=75400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:46 devstack cinder-volume[75400]: WARNING amqp [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 08:31:46 devstack cinder-volume[75400]: WARNING amqp [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 08:31:46 devstack cinder-volume[75229]: INFO oslo_service.backend._eventlet.service [None req-c6ecc31a-a4c6-4a48-aa0f-ef39c0e20b86 None None] Child 75400 exited with status 0
Apr 29 08:31:49 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:49 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:49 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:49 devstack cinder-volume[83046]: INFO dbcounter [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Registered counter for database cinder
Apr 29 08:31:49 devstack cinder-volume[83046]: DEBUG oslo_db.sqlalchemy.engines [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG dbcounter [-] [83046] Writer thread running {{(pid=83046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:31:50 devstack cinder-volume[83046]: INFO cinder.rpc [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 08:31:50 devstack cinder-volume[83046]: INFO cinder.rpc [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_db.sqlalchemy.engines [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:50 devstack cinder-volume[83046]: INFO cinder.volume.manager [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Determined volume DB was empty at startup.
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG cinder.volume.manager [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83046) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 08:31:50 devstack cinder-volume[83046]: INFO cinder.volume.manager [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 29 08:31:50 devstack cinder-volume[83046]: WARNING stevedore.named [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 08:31:50 devstack cinder-volume[83046]: WARNING castellan.key_manager [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:31:50 devstack cinder-volume[83046]: WARNING cinder.keymgr.conf_key_mgr [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:31:50 devstack cinder-volume[83046]: INFO cinder.volume.manager [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_db.sqlalchemy.engines [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:50 devstack cinder-volume[83046]: INFO oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Starting 1 workers
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Started child 83242 {{(pid=83046) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Full set of CONF: {{(pid=83046) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] ******************************************************************************** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Configuration options gathered from: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] ================================================================================ {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] allow_availability_zone_fallback = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] allow_compression_on_image_upload = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] allowed_direct_url_schemes     = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] api_rate_limit                 = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] auth_strategy                  = keystone {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_availability_zone      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_host                   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_name                   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_stats_polling_interval = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backup_api_class               = cinder.backup.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backup_name_template           = backup-%s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backup_use_same_host           = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83242]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0)
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backup_use_temp_snapshot       = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] chap_password                  = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] chap_username                  =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cinder_internal_tenant_project_id = 3c578a205f9a4248b59555df754409d5 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cinder_internal_tenant_user_id = 447b297519a84588a10326a302e927f1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cluster                        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] compression_format             = gzip {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] compute_api_class              = cinder.compute.nova.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] config_dir                     = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] config_source                  = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] control_exchange               = openstack {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] debug                          = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] default_availability_zone      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] default_group_type             = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] default_volume_type            = QuobyteHD {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] disk_geometry                  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] driver_client_cert             = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] driver_client_cert_key         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] driver_data_namespace          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] driver_ssl_cert_path           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] driver_ssl_cert_verify         = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] driver_use_ssl                 = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] enable_new_services            = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] enable_unsupported_driver      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] enabled_backends               = ['QuobyteHD'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] enforce_multipath_for_image_xfer = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] filter_function                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_api_insecure            = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_api_servers             = ['http://192.168.122.243/image'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_api_ssl_compression     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_ca_certificates_file    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_catalog_info            = image:glance:publicURL {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_certfile                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_keyfile                 = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_num_retries             = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance_request_timeout         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] goodness_function              = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] graceful_shutdown_timeout      = 5 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] group_api_class                = cinder.group.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] host                           = devstack {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_compress_on_upload       = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_conversion_address_space_limit = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_conversion_cpu_limit     = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_conversion_disable       = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_upload_use_cinder_backend = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_upload_use_internal_tenant = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_volume_cache_enabled     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_volume_cache_max_count   = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] image_volume_cache_max_size_gb = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] init_host_max_objects_retrieval = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] instance_format                = [instance: %(uuid)s]  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] iscsi_target_flags             =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] iscsi_write_cache              = on {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] iser_helper                    = tgtadm {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] iser_ip_address                = 192.168.122.243 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] iser_port                      = 3260 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] log_color                      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] log_config_append              = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] log_dir                        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] log_file                       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] log_options                    = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] log_rotate_interval            = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] log_rotate_interval_type       = days {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] log_rotation_type              = none {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] max_age                        = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] max_logfile_count              = 30 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] max_logfile_size_mb            = 200 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] max_over_subscription_ratio    = 20.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] message_reap_interval          = 86400 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] message_ttl                    = 2592000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] migration_create_volume_timeout_secs = 300 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] monkey_patch                   = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] monkey_patch_modules           = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] my_ip                          = 192.168.122.243 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] no_snapshot_gb_quota           = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] num_iser_scan_tries            = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] num_shell_tries                = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] num_volume_device_scan_tries   = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] nvmeof_conn_info_version       = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] nvmet_ns_id                    = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] nvmet_port_id                  = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] osapi_max_limit                = 1000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] osapi_volume_ext_list          = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] osapi_volume_listen_port       = 8776 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] osapi_volume_use_ssl           = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] osapi_volume_workers           = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] per_volume_size_limit          = -1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] periodic_fuzzy_delay           = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] periodic_interval              = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] public_endpoint                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] publish_errors                 = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] quota_backup_gigabytes         = 1000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] quota_backups                  = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] quota_gigabytes                = 1000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] quota_groups                   = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] quota_snapshots                = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] quota_volumes                  = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] rate_limit_burst               = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] rate_limit_except_level        = CRITICAL {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] rate_limit_interval            = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] reinit_driver_count            = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] replication_device             = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] report_discard_supported       = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] report_interval                = 120 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] reservation_clean_interval     = 86400 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] reservation_expire             = 86400 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] reserved_image_namespaces      = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] reserved_percentage            = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] rpc_response_timeout           = 120 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] run_external_periodic_tasks    = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] scst_target_driver             = iscsi {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] scst_target_iqn_name           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_down_time              = 720 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] shell_completion               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] snapshot_name_template         = snapshot-%s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] split_loggers                  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] state_path                     = /opt/stack/data/cinder {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] storage_availability_zone      = nova {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] storage_protocol               = iSCSI {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] syslog_log_facility            = LOG_USER {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] target_helper                  = lioadm {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] target_ip_address              = 192.168.122.243 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] target_port                    = 3260 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] target_protocol                = iscsi {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] target_secondary_ip_addresses  = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] trace_flags                    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] transport_url                  = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] until_refresh                  = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] use_chap_auth                  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] use_default_quota_class        = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] use_journal                    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] use_json                       = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] use_multipath_for_image_xfer   = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] use_stderr                     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] use_syslog                     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] verify_glance_signatures       = enabled {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_api_class               = cinder.volume.api.API {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_backend_name            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_clear                   = zero {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_clear_ionice            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_clear_size              = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_copy_bps_limit          = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_dd_blocksize            = 1M {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_name_template           = volume-%s {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_service_inithost_offload = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volume_usage_audit_period      = month {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] zoning_mode                    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_concurrency.disable_process_locking = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.admin_password = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83242]: INFO cinder.volume.manager [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.remotefs [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83242) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.admin_token = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.admin_user  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.auth_port   = 35357 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.auth_protocol = https {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.auth_section = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.auth_type   = password {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.auth_uri    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.auth_version = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.cache       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.certfile    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.delay_auth_decision = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.http_connect_timeout = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.identity_uri = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.include_service_catalog = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.insecure    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.interface   = public {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.keyfile     = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_password =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcache_username =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.region_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.service_token_roles_required = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.service_type = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.token_cache_time = 300 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.243/identity {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.backend                  = dogpile.cache.null {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.backend_argument         = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.backend_expiration_time  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.config_prefix            = cache.oslo {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.debug_cache_backend      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.enable_retry_client      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.enable_socket_keepalive  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.enabled                  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.enforce_fips_mode        = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.expiration_time          = 600 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.hashclient_retry_attempts = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.memcache_dead_retry      = 300 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.memcache_pool_maxsize    = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.memcache_sasl_enabled    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.password                 = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.proxies                  = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.redis_db                 = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.redis_sentinel_service_name = mymaster {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.redis_server             = localhost:6379 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.retry_attempts           = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.retry_delay              = 0.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.socket_keepalive_count   = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.socket_keepalive_idle    = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.socket_keepalive_interval = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.socket_timeout           = 1.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.tls_allowed_ciphers      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.tls_cafile               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.tls_certfile             = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.tls_enabled              = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.tls_keyfile              = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cache.username                 = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] coordination.backend_url       = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.asyncio_connection    = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.asyncio_slave_connection = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.backend               = sqlalchemy {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.connection            = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.connection_debug      = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.connection_parameters =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.connection_recycle_time = 3600 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.connection_trace      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.db_inc_retry_interval = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.db_max_retries        = 20 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.db_max_retry_interval = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.db_retry_interval     = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.max_overflow          = 50 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.max_pool_size         = 5 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.max_retries           = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.mysql_wsrep_sync_wait = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.pool_timeout          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.retry_interval        = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.slave_connection      = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.sqlite_synchronous    = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.synchronous_reader    = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] database.use_db_reconnect      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.connection_string     = messaging:// {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.enabled               = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.es_doc_type           = notification {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.es_scroll_size        = 10000 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.es_scroll_time        = 2m {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.filter_error_trace    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.hmac_keys             = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.sentinel_service_name = mymaster {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.socket_timeout        = 0.1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.trace_requests        = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler.trace_sqlalchemy      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler_jaeger.process_tags   = {} {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler_jaeger.service_name_prefix = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] profiler_otlp.service_name_prefix = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.enforce_new_defaults = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: WARNING oslo_config.cfg [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.enforce_scope      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.policy_default_rule = default {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.policy_file        = policy.yaml {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] privsep_osbrick.group          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] privsep_osbrick.helper_command = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] privsep_osbrick.user           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cinder_sys_admin.group         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cinder_sys_admin.helper_command = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] cinder_sys_admin.user          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.auth_section      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.auth_type         = password {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.cafile            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.certfile          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.collect_timing    = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.insecure          = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.keyfile           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.send_service_user_token = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.split_loggers     = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] service_user.timeout           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.auth_section            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.auth_type               = password {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.certfile                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.collect_timing          = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.insecure                = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.keyfile                 = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.region_name             = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.split_loggers           = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] glance.timeout                 = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.backend_availability_zone = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.chap_password = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.chap_username =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.disk_geometry = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.driver_client_cert = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.driver_client_cert_key = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.driver_data_namespace = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.driver_use_ssl = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.enable_unsupported_driver = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.extra_capabilities = {} {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.filter_function = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.goodness_function = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83242) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 29 08:31:50 devstack cinder-volume[83242]: WARNING cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 29 08:31:50 devstack cinder-volume[83242]: WARNING cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.iscsi_target_flags =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.iscsi_write_cache = on {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.iser_helper   = tgtadm {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Running cmd (subprocess): mount.quobyte {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.iser_ip_address = 192.168.122.243 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.iser_port     = 3260 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_host      =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_login     = admin {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_mount_options = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_password  = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_private_key =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_share_path =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.num_shell_tries = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.nvmet_port_id = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.quobyte_client_cfg = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.quobyte_volume_url = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.replication_device = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.report_discard_supported = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.reserved_percentage = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.scst_target_driver = iscsi {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.scst_target_iqn_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.storage_protocol = iSCSI {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.target_helper = tgtadm {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.target_ip_address = 192.168.122.243 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.target_port   = 3260 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.target_protocol = iscsi {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.trace_flags   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.unique_fqdn_network = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.use_chap_auth = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.volume_backend_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.volume_clear  = zero {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.volume_clear_ionice = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.volume_clear_size = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_reports.file_event_handler = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_reports.log_dir           = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.backend_availability_zone = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.backend_host         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.chap_password        = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.chap_username        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.chiscsi_conf         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.disk_geometry        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.driver_client_cert   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.driver_client_cert_key = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.driver_data_namespace = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.driver_use_ssl       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.extra_capabilities   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.filter_function      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.goodness_function    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.iser_helper          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.iser_ip_address      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.iser_port            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.iser_target_prefix   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_host             = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_login            = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_mount_options    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_password         = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_private_key      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_share_path       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_ssh_port         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.num_shell_tries      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.nvmet_port_id        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.replication_device   = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.report_discard_supported = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.reserved_percentage  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.scst_target_driver   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.storage_protocol     = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.target_helper        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.target_ip_address    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.target_port          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.target_prefix        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.target_protocol      = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.trace_flags          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.use_chap_auth        = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.volume_clear         = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.volume_clear_size    = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] QuobyteHD.volumes_dir          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:50 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.ssl      = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_notifications.driver = [] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_notifications.retry = -1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] oslo_messaging_notifications.transport_url = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] key_manager.fixed_key          = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.barbican_api_version  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.barbican_endpoint     = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.barbican_endpoint_type = public {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.barbican_region_name  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.cafile                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.certfile              = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.collect_timing        = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.insecure              = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.keyfile               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.number_of_retries     = 60 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.retry_delay           = 1 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.send_service_user_token = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.split_loggers         = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.timeout               = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.verify_ssl            = True {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican.verify_ssl_path       = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican_service_user.auth_section = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican_service_user.auth_type = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican_service_user.cafile   = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican_service_user.certfile = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican_service_user.collect_timing = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican_service_user.insecure = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican_service_user.keyfile  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican_service_user.split_loggers = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] barbican_service_user.timeout  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.approle_role_id          = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.approle_secret_id        = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.kv_mountpoint            = secret {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.kv_path                  = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.kv_version               = 2 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.namespace                = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.root_token_id            = **** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.ssl_ca_crt_file          = None {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack quobyte-client[83333]: Reading configuration file: /etc/quobyte/client.cfg
Apr 29 08:31:51 devstack quobyte-client[83333]: Invalid parameters found, error: missing mount point.
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.timeout                  = 60.0 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack quobyte-client[83333]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.use_ssl                  = False {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:51 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] ******************************************************************************** {{(pid=83046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 08:31:51 devstack quobyte-client[83333]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 29 08:31:51 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] CMD "mount.quobyte" returned: 1 in 0.157s {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:51 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:51 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:51 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:51 devstack cinder-volume[83242]: INFO cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 ...
Apr 29 08:31:51 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 -c /etc/quobyte/client-cinder.cfg {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:51 devstack sudo[83335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 -c /etc/quobyte/client-cinder.cfg
Apr 29 08:31:51 devstack sudo[83335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:51 devstack sudo[83335]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:51 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.921s {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:51 devstack cinder-volume[83242]: INFO cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 succeeded
Apr 29 08:31:51 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:51 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.934s {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:51 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:52 devstack sudo[83424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:31:52 devstack sudo[83424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:52 devstack sudo[83424]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:52 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.923s {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:52 devstack cinder-volume[83242]: INFO cinder.volume.driver [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 08:31:52 devstack cinder-volume[83242]: DEBUG cinder.volume.driver [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515808105469, 'free_capacity_gb': 1775.6515808105469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83242) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 08:31:52 devstack cinder-volume[83242]: DEBUG oslo_db.sqlalchemy.engines [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83242) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:52 devstack cinder-volume[83242]: DEBUG dbcounter [-] [83242] Writer thread running {{(pid=83242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:31:52 devstack cinder-volume[83242]: DEBUG cinder.db.sqlalchemy.api [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Building query based on filter {{(pid=83242) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG cinder.image.image_utils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83242) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 08:31:53 devstack cinder-volume[83242]: INFO cinder.keymgr.migration [None req-355a2328-c753-47a5-8243-2dadd57043fe None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:53 devstack sudo[83473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:31:53 devstack sudo[83473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:53 devstack sudo[83473]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.805s {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG cinder.manager [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Notifying Schedulers of capabilities ... {{(pid=83242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:31:53 devstack cinder-volume[83242]: INFO cinder.volume.manager [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Driver initialization completed successfully.
Apr 29 08:31:53 devstack cinder-volume[83242]: INFO cinder.manager [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Initiating service 3 cleanup
Apr 29 08:31:53 devstack cinder-volume[83242]: INFO cinder.manager [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Service 3 cleanup completed.
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG cinder.service [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Creating RPC server for service cinder-volume {{(pid=83242) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 08:31:53 devstack cinder-volume[83242]: DEBUG cinder.service [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83242) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 08:31:54 devstack cinder-volume[83242]: INFO cinder.volume.manager [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 29 08:31:54 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:54 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:54 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:54 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.quobyte [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:54 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:54 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:54 devstack sudo[83571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:31:54 devstack sudo[83571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:54 devstack sudo[83571]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:54 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.677s {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:54 devstack cinder-volume[83242]: INFO cinder.volume.manager [None req-152b01cb-cb31-4ca1-8074-43d48204bc60 None None] Driver post RPC initialization completed successfully.
Apr 29 08:31:57 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:57 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:57 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.quobyte [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83242) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:57 devstack cinder-volume[83242]: DEBUG cinder.volume.drivers.quobyte [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83242) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:57 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83242) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:57 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:57 devstack sudo[83586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:31:57 devstack sudo[83586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:57 devstack cinder-volume[83046]: INFO oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Caught SIGTERM, stopping children
Apr 29 08:31:57 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Acquiring lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:57 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Acquired lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:57 devstack cinder-volume[83046]: DEBUG oslo_concurrency.lockutils [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Releasing lock "singleton_lock" {{(pid=83046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:57 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Stop services. {{(pid=83046) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 29 08:31:57 devstack cinder-volume[83046]: DEBUG oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Killing children. {{(pid=83046) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 29 08:31:57 devstack cinder-volume[83046]: INFO oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Waiting on 1 children to exit
Apr 29 08:31:57 devstack sudo[83586]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:57 devstack cinder-volume[83242]: DEBUG oslo_concurrency.processutils [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.660s {{(pid=83242) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:57 devstack cinder-volume[83242]: DEBUG cinder.manager [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Notifying Schedulers of capabilities ... {{(pid=83242) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Unable to connect to AMQP server on 192.168.122.243:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server [None req-56770552-c33e-4d0e-a9cf-e989d638155c None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.243:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     method()
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     return _publish(
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     listener(*args)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server 
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server 
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     self.transport._send(self.target, msg_ctxt, msg,
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.243:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:57 devstack cinder-volume[83242]: ERROR oslo_messaging.rpc.server 
Apr 29 08:31:58 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Acquiring lock "singleton_lock" {{(pid=83242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:58 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Acquired lock "singleton_lock" {{(pid=83242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:58 devstack cinder-volume[83242]: DEBUG oslo_concurrency.lockutils [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Releasing lock "singleton_lock" {{(pid=83242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:58 devstack cinder-volume[83242]: WARNING amqp [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 08:31:58 devstack cinder-volume[83242]: WARNING amqp [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 08:31:58 devstack cinder-volume[83046]: INFO oslo_service.backend._eventlet.service [None req-a8e2e0c8-7954-4bc7-8407-f081a6a9150b None None] Child 83242 exited with status 0
Apr 29 08:32:02 devstack cinder-volume[83643]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83643) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:32:02 devstack cinder-volume[83643]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83643) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:32:02 devstack cinder-volume[83643]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83643) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:32:03 devstack cinder-volume[83643]: INFO dbcounter [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Registered counter for database cinder
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_db.sqlalchemy.engines [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG dbcounter [-] [83643] Writer thread running {{(pid=83643) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:32:03 devstack cinder-volume[83643]: INFO cinder.rpc [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 08:32:03 devstack cinder-volume[83643]: INFO cinder.rpc [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_db.sqlalchemy.engines [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:32:03 devstack cinder-volume[83643]: INFO cinder.volume.manager [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Determined volume DB was empty at startup.
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG cinder.volume.manager [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83643) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 08:32:03 devstack cinder-volume[83643]: WARNING stevedore.named [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 08:32:03 devstack cinder-volume[83643]: WARNING castellan.key_manager [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:32:03 devstack cinder-volume[83643]: WARNING cinder.keymgr.conf_key_mgr [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:32:03 devstack cinder-volume[83643]: INFO cinder.volume.manager [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_db.sqlalchemy.engines [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:32:03 devstack cinder-volume[83643]: INFO oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Starting 1 workers
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Started child 83885 {{(pid=83643) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Full set of CONF: {{(pid=83643) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] ******************************************************************************** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Configuration options gathered from: {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] ================================================================================ {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] allow_availability_zone_fallback = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] allow_compression_on_image_upload = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] allowed_direct_url_schemes     = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] api_rate_limit                 = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] auth_strategy                  = keystone {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_availability_zone      = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83885]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0)
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_host                   = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_name                   = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_stats_polling_interval = 60 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backup_api_class               = cinder.backup.api.API {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backup_name_template           = backup-%s {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backup_use_same_host           = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backup_use_temp_snapshot       = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] chap_password                  = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] chap_username                  =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cinder_internal_tenant_project_id = 3c578a205f9a4248b59555df754409d5 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cinder_internal_tenant_user_id = 447b297519a84588a10326a302e927f1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cluster                        = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] compression_format             = gzip {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] compute_api_class              = cinder.compute.nova.API {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] config_dir                     = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] config_source                  = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] control_exchange               = openstack {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] debug                          = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] default_availability_zone      = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] default_group_type             = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] default_volume_type            = QuobyteHD {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] disk_geometry                  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] driver_client_cert             = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] driver_client_cert_key         = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] driver_data_namespace          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] driver_ssl_cert_path           = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] driver_ssl_cert_verify         = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] driver_use_ssl                 = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] enable_new_services            = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] enable_unsupported_driver      = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:03 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] enabled_backends               = ['QuobyteHD'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] enforce_multipath_for_image_xfer = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] filter_function                = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_api_insecure            = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_api_servers             = ['http://192.168.122.243/image'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_api_ssl_compression     = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_ca_certificates_file    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_catalog_info            = image:glance:publicURL {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_certfile                = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_keyfile                 = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_num_retries             = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance_request_timeout         = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] goodness_function              = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] graceful_shutdown_timeout      = 5 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] group_api_class                = cinder.group.api.API {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] host                           = devstack {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_compress_on_upload       = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_conversion_address_space_limit = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_conversion_cpu_limit     = 60 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_conversion_disable       = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_upload_use_cinder_backend = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_upload_use_internal_tenant = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_volume_cache_enabled     = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_volume_cache_max_count   = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] image_volume_cache_max_size_gb = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] init_host_max_objects_retrieval = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] instance_format                = [instance: %(uuid)s]  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] iscsi_target_flags             =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] iscsi_write_cache              = on {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] iser_helper                    = tgtadm {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] iser_ip_address                = 192.168.122.243 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] iser_port                      = 3260 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] log_color                      = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] log_config_append              = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83885) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] log_dir                        = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] log_file                       = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] log_options                    = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] log_rotate_interval            = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] log_rotate_interval_type       = days {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] log_rotation_type              = none {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] max_age                        = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] max_logfile_count              = 30 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] max_logfile_size_mb            = 200 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] max_over_subscription_ratio    = 20.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] message_reap_interval          = 86400 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] message_ttl                    = 2592000 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] migration_create_volume_timeout_secs = 300 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] monkey_patch                   = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] monkey_patch_modules           = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] my_ip                          = 192.168.122.243 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] no_snapshot_gb_quota           = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] num_iser_scan_tries            = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] num_shell_tries                = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] num_volume_device_scan_tries   = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] nvmeof_conn_info_version       = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] nvmet_ns_id                    = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] nvmet_port_id                  = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] osapi_max_limit                = 1000 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] osapi_volume_ext_list          = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] osapi_volume_listen_port       = 8776 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] osapi_volume_use_ssl           = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] osapi_volume_workers           = 2 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] per_volume_size_limit          = -1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] periodic_fuzzy_delay           = 60 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] periodic_interval              = 60 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] public_endpoint                = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] publish_errors                 = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] quota_backup_gigabytes         = 1000 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] quota_backups                  = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] quota_gigabytes                = 1000 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] quota_groups                   = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] quota_snapshots                = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] quota_volumes                  = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] rate_limit_burst               = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] rate_limit_except_level        = CRITICAL {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] rate_limit_interval            = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] reinit_driver_count            = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] replication_device             = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] report_discard_supported       = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] report_interval                = 120 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] reservation_clean_interval     = 86400 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] reservation_expire             = 86400 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] reserved_image_namespaces      = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] reserved_percentage            = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] rpc_response_timeout           = 120 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] run_external_periodic_tasks    = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] scst_target_driver             = iscsi {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] scst_target_iqn_name           = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_down_time              = 720 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] shell_completion               = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] snapshot_name_template         = snapshot-%s {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] split_loggers                  = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] state_path                     = /opt/stack/data/cinder {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] storage_availability_zone      = nova {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] storage_protocol               = iSCSI {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] syslog_log_facility            = LOG_USER {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] target_helper                  = lioadm {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] target_ip_address              = 192.168.122.243 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] target_port                    = 3260 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] target_protocol                = iscsi {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] target_secondary_ip_addresses  = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] trace_flags                    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] transport_url                  = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] until_refresh                  = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] use_chap_auth                  = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] use_default_quota_class        = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] use_journal                    = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] use_json                       = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] use_multipath_for_image_xfer   = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] use_stderr                     = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] use_syslog                     = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] verify_glance_signatures       = enabled {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_api_class               = cinder.volume.api.API {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_backend_name            = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_clear                   = zero {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_clear_ionice            = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_clear_size              = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_copy_bps_limit          = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_dd_blocksize            = 1M {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_name_template           = volume-%s {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_service_inithost_offload = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volume_usage_audit_period      = month {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] zoning_mode                    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_concurrency.disable_process_locking = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.admin_password = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.admin_token = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.admin_user  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.auth_port   = 35357 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.auth_protocol = https {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.auth_section = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.auth_type   = password {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.auth_uri    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.auth_version = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.cache       = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.certfile    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.delay_auth_decision = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.http_connect_timeout = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.identity_uri = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.include_service_catalog = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.insecure    = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.interface   = public {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.keyfile     = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_password =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcache_username =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.region_name = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.service_token_roles_required = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.service_type = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.token_cache_time = 300 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.243/identity {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.backend                  = dogpile.cache.null {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.backend_argument         = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.backend_expiration_time  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.config_prefix            = cache.oslo {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.debug_cache_backend      = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.enable_retry_client      = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.enable_socket_keepalive  = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.enabled                  = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.enforce_fips_mode        = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.expiration_time          = 600 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.hashclient_retry_attempts = 2 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.memcache_dead_retry      = 300 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.memcache_pool_maxsize    = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.memcache_sasl_enabled    = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.password                 = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.proxies                  = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.redis_db                 = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.redis_sentinel_service_name = mymaster {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.redis_server             = localhost:6379 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.retry_attempts           = 2 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.retry_delay              = 0.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.socket_keepalive_count   = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.socket_keepalive_idle    = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.socket_keepalive_interval = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.socket_timeout           = 1.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.tls_allowed_ciphers      = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.tls_cafile               = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.tls_certfile             = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.tls_enabled              = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.tls_keyfile              = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cache.username                 = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] coordination.backend_url       = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.asyncio_connection    = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.asyncio_slave_connection = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.backend               = sqlalchemy {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.connection            = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.connection_debug      = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.connection_parameters =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.connection_recycle_time = 3600 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.connection_trace      = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.db_inc_retry_interval = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.db_max_retries        = 20 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.db_max_retry_interval = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.db_retry_interval     = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.max_overflow          = 50 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.max_pool_size         = 5 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.max_retries           = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.mysql_wsrep_sync_wait = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.pool_timeout          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.retry_interval        = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.slave_connection      = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.sqlite_synchronous    = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.synchronous_reader    = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] database.use_db_reconnect      = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.connection_string     = messaging:// {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.enabled               = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.es_doc_type           = notification {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.es_scroll_size        = 10000 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.es_scroll_time        = 2m {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.filter_error_trace    = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.hmac_keys             = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.sentinel_service_name = mymaster {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.socket_timeout        = 0.1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.trace_requests        = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler.trace_sqlalchemy      = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler_jaeger.process_tags   = {} {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler_jaeger.service_name_prefix = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] profiler_otlp.service_name_prefix = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.enforce_new_defaults = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: WARNING oslo_config.cfg [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.enforce_scope      = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.policy_default_rule = default {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.policy_file        = policy.yaml {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] privsep_osbrick.group          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] privsep_osbrick.helper_command = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] privsep_osbrick.user           = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cinder_sys_admin.group         = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cinder_sys_admin.helper_command = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] cinder_sys_admin.user          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.auth_section      = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.auth_type         = password {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.cafile            = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.certfile          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.collect_timing    = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.insecure          = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.keyfile           = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.send_service_user_token = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.split_loggers     = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] service_user.timeout           = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.auth_section            = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.auth_type               = password {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack quobyte-client[83891]: Reading configuration file: /etc/quobyte/client.cfg
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.certfile                = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.collect_timing          = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.insecure                = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.keyfile                 = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.region_name             = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.split_loggers           = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack quobyte-client[83891]: Invalid parameters found, error: missing mount point.
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] glance.timeout                 = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.backend_availability_zone = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.chap_password = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.chap_username =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack quobyte-client[83891]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.disk_geometry = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.driver_client_cert = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.driver_client_cert_key = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.driver_data_namespace = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack quobyte-client[83891]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.driver_use_ssl = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.enable_unsupported_driver = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.extra_capabilities = {} {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.filter_function = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.goodness_function = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.iscsi_target_flags =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.iscsi_write_cache = on {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.iser_helper   = tgtadm {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.iser_ip_address = 192.168.122.243 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.iser_port     = 3260 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_host      =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_login     = admin {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_mount_options = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_password  = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_private_key =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_share_path =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.num_shell_tries = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.nvmet_port_id = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.quobyte_client_cfg = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.quobyte_volume_url = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.replication_device = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.report_discard_supported = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.reserved_percentage = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.scst_target_driver = iscsi {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.scst_target_iqn_name = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.storage_protocol = iSCSI {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.target_helper = tgtadm {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.target_ip_address = 192.168.122.243 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.target_port   = 3260 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.target_protocol = iscsi {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83885) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.trace_flags   = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.quobyte [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 29 08:32:04 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.quobyte [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.unique_fqdn_network = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Running cmd (subprocess): mount.quobyte {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.use_chap_auth = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.volume_backend_name = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.volume_clear  = zero {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.volume_clear_ionice = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.volume_clear_size = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack sudo[83892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_reports.file_event_handler = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack sudo[83892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_reports.log_dir           = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.backend_availability_zone = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.backend_host         = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.chap_password        = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.chap_username        = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.chiscsi_conf         = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.disk_geometry        = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.driver_client_cert   = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.driver_client_cert_key = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.driver_data_namespace = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.driver_use_ssl       = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.extra_capabilities   = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.filter_function      = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.goodness_function    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.iser_helper          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.iser_ip_address      = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.iser_port            = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.iser_target_prefix   = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_host             = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_login            = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_mount_options    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_password         = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_private_key      = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_share_path       = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_ssh_port         = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.num_shell_tries      = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.nvmet_port_id        = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.replication_device   = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.report_discard_supported = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.reserved_percentage  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.scst_target_driver   = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.storage_protocol     = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.target_helper        = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.target_ip_address    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.target_port          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.target_prefix        = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.target_protocol      = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.trace_flags          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.use_chap_auth        = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.volume_clear         = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.volume_clear_size    = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] QuobyteHD.volumes_dir          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.ssl      = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_notifications.driver = [] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_notifications.retry = -1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] oslo_messaging_notifications.transport_url = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] key_manager.fixed_key          = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.barbican_api_version  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.barbican_endpoint     = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.barbican_endpoint_type = public {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.barbican_region_name  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.cafile                = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.certfile              = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.collect_timing        = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.insecure              = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.keyfile               = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.number_of_retries     = 60 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.retry_delay           = 1 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.send_service_user_token = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.split_loggers         = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.timeout               = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.verify_ssl            = True {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican.verify_ssl_path       = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican_service_user.auth_section = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican_service_user.auth_type = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican_service_user.cafile   = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican_service_user.certfile = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican_service_user.collect_timing = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican_service_user.insecure = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican_service_user.keyfile  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican_service_user.split_loggers = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] barbican_service_user.timeout  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.approle_role_id          = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.approle_secret_id        = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.kv_mountpoint            = secret {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.kv_path                  = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.kv_version               = 2 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.namespace                = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.root_token_id            = **** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.ssl_ca_crt_file          = None {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.timeout                  = 60.0 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.use_ssl                  = False {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:32:04 devstack cinder-volume[83643]: DEBUG oslo_service.backend._eventlet.service [None req-ceaa0f33-95d9-4a2e-8f5b-f659939884cc None None] ******************************************************************************** {{(pid=83643) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] CMD "mount.quobyte" returned: 1 in 0.136s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:32:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:32:05 devstack sudo[83892]: pam_unix(sudo:session): session closed for user root
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.822s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:32:05 devstack cinder-volume[83885]: INFO cinder.volume.driver [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG cinder.volume.driver [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515808105469, 'free_capacity_gb': 1775.6515808105469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83885) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG oslo_db.sqlalchemy.engines [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83885) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writer thread running {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG cinder.db.sqlalchemy.api [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Building query based on filter {{(pid=83885) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83885) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:32:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:32:05 devstack cinder-volume[83885]: INFO cinder.keymgr.migration [None req-3db706b3-1599-4e0a-88f1-bc3b6e091a15 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 08:32:05 devstack sudo[83897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:32:05 devstack sudo[83897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:32:06 devstack sudo[83897]: pam_unix(sudo:session): session closed for user root
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.717s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:32:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Driver initialization completed successfully.
Apr 29 08:32:06 devstack cinder-volume[83885]: INFO cinder.manager [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Initiating service 3 cleanup
Apr 29 08:32:06 devstack cinder-volume[83885]: INFO cinder.manager [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Service 3 cleanup completed.
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG cinder.service [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Creating RPC server for service cinder-volume {{(pid=83885) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG cinder.service [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83885) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 08:32:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:32:06 devstack sudo[83923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:32:06 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:32:06 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root
Apr 29 08:32:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.593s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:32:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ca7d5c3f-6346-40aa-b093-7f830007ec41 None None] Driver post RPC initialization completed successfully.
Apr 29 08:32:13 devstack cinder-volume[83643]: DEBUG dbcounter [-] [83643] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83643) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:32:15 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=1 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:32:16 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Flow 'volume_create_manager' (99ee1ceb-d8d0-4c74-9b8f-a115f5e523b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d79cbba-6294-42fe-ab1e-7ed0c5d6a44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d79cbba-6294-42fe-ab1e-7ed0c5d6a44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1442846491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2252f7c8-78e7-40c0-abb6-2d4816bb40ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16036772785f4fffb33e21591a0b500f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:05Z,use_quota=True,user_id='fa351cf6bde84e3ab8b74ba61dae45d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c071747-12f2-42ad-bfe4-3b52b5dfaf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c071747-12f2-42ad-bfe4-3b52b5dfaf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393d9390-c185-4d7c-b91c-f55893ff67ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393d9390-c185-4d7c-b91c-f55893ff67ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2252f7c8-78e7-40c0-abb6-2d4816bb40ec', 'volume_name': 'volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046ff331-473f-4b30-8ad9-540d54d86fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046ff331-473f-4b30-8ad9-540d54d86fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc9c315-d2fc-4537-943e-1e04252a2c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:05 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Volume 2252f7c8-78e7-40c0-abb6-2d4816bb40ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec', 'volume_size': 1}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1442846491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2252f7c8-78e7-40c0-abb6-2d4816bb40ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16036772785f4fffb33e21591a0b500f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:05Z,use_quota=True,user_id='fa351cf6bde84e3ab8b74ba61dae45d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Creating volume 2252f7c8-78e7-40c0-abb6-2d4816bb40ec {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:33:06 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:33:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e210a0c9-3afb-4cd1-9339-b98abbc786e3 tempest-GroupSnapshotsV319Test-1959004423 None] Group tempest-GroupSnapshotsV319Test-Group-1626480342: creating
Apr 29 08:33:06 devstack sudo[84439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec 1073741824
Apr 29 08:33:06 devstack sudo[84439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e210a0c9-3afb-4cd1-9339-b98abbc786e3 tempest-GroupSnapshotsV319Test-1959004423 None] Group tempest-GroupSnapshotsV319Test-Group-1626480342: created successfully
Apr 29 08:33:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e210a0c9-3afb-4cd1-9339-b98abbc786e3 tempest-GroupSnapshotsV319Test-1959004423 None] Create group completed successfully.
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Flow 'volume_create_manager' (b768aaf7-a620-4a7c-89b3-138128b4faf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1060ca0-244a-42d8-b681-6cb2c5515be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1060ca0-244a-42d8-b681-6cb2c5515be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1430959866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d7a5c3e2-eda3-4f40-b2b2-bc47b0db9d76,host='devstack@QuobyteHD#QuobyteHD',id=276e847f-8c16-4240-a0c7-1def390d7508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5921f6c92018485cb388ab8396d863ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:08Z,use_quota=True,user_id='5924da8036ad46edacf1ed9849ae49fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfaaf927-3630-4071-b119-38a060de2774),volume_type_id=cfaaf927-3630-4071-b119-38a060de2774)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d076a55-f12c-43bd-8757-a31d547dea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d076a55-f12c-43bd-8757-a31d547dea2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:08 devstack sudo[84439]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca1dcb9-8ef7-48e3-8486-7f2c3a92e137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca1dcb9-8ef7-48e3-8486-7f2c3a92e137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276e847f-8c16-4240-a0c7-1def390d7508', 'volume_name': 'volume-276e847f-8c16-4240-a0c7-1def390d7508', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45951f9-b1b7-4aa2-957b-8d2dd3edaa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45951f9-b1b7-4aa2-957b-8d2dd3edaa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394351e6-3d2e-4c5f-94c8-40c4c2bf8392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:08 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Volume 276e847f-8c16-4240-a0c7-1def390d7508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276e847f-8c16-4240-a0c7-1def390d7508', 'volume_size': 1}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec 1073741824" returned: 0 in 2.320s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:08 devstack sudo[84766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec
Apr 29 08:33:08 devstack sudo[84766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:09 devstack sudo[84766]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec" returned: 0 in 1.064s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] <== create_volume: return (3549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.556s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d7a5c3e2-eda3-4f40-b2b2-bc47b0db9d76,created_at=2026-04-29T06:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1430959866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d7a5c3e2-eda3-4f40-b2b2-bc47b0db9d76,host='devstack@QuobyteHD#QuobyteHD',id=276e847f-8c16-4240-a0c7-1def390d7508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5921f6c92018485cb388ab8396d863ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:08Z,use_quota=True,user_id='5924da8036ad46edacf1ed9849ae49fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfaaf927-3630-4071-b119-38a060de2774),volume_type_id=cfaaf927-3630-4071-b119-38a060de2774)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Creating volume 276e847f-8c16-4240-a0c7-1def390d7508 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:33:09 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:09 devstack sudo[84770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508 1073741824
Apr 29 08:33:09 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc9c315-d2fc-4537-943e-1e04252a2c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663bc745-cb10-4c07-b0ab-d255f4c46b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:09 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Volume volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec (2252f7c8-78e7-40c0-abb6-2d4816bb40ec): created successfully
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663bc745-cb10-4c07-b0ab-d255f4c46b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Flow 'volume_create_manager' (99ee1ceb-d8d0-4c74-9b8f-a115f5e523b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-92707254-3034-4897-a68b-c86b7acd147c tempest-DeleteServersTestJSON-626164797 None] Created volume successfully.
Apr 29 08:33:11 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508 1073741824" returned: 0 in 2.140s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:11 devstack sudo[84850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508
Apr 29 08:33:11 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:13 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508" returned: 0 in 1.648s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] <== create_volume: return (3956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:33:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.968s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394351e6-3d2e-4c5f-94c8-40c4c2bf8392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276e847f-8c16-4240-a0c7-1def390d7508', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1ee4ac-b54a-4de8-8bfc-b0ad11ce1a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:13 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Volume volume-276e847f-8c16-4240-a0c7-1def390d7508 (276e847f-8c16-4240-a0c7-1def390d7508): created successfully
Apr 29 08:33:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1ee4ac-b54a-4de8-8bfc-b0ad11ce1a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Flow 'volume_create_manager' (b768aaf7-a620-4a7c-89b3-138128b4faf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:13 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ad6510e8-1858-4e36-853d-65ca7091a146 tempest-GroupSnapshotsV319Test-1959004423 None] Created volume successfully.
Apr 29 08:33:15 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] GroupSnapshot cdd833b1-3c4d-47af-9e48-9fa9d1c71624: creating.
Apr 29 08:33:15 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Group snapshot cdd833b1-3c4d-47af-9e48-9fa9d1c71624: creating. {{(pid=83885) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 08:33:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:15 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Creating offline snapshot 49d89ca3-2d6e-4a32-be37-945189a034d2 of volume 276e847f-8c16-4240-a0c7-1def390d7508 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:33:15 devstack cinder-volume[83885]: INFO oslo.privsep.daemon [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp60fvomfx/privsep.sock']
Apr 29 08:33:15 devstack sudo[84898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp60fvomfx/privsep.sock
Apr 29 08:33:15 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:16 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Flow 'volume_create_manager' (3b54c1dc-8e3a-41c1-9710-d5426476f4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6443f1b3-1de9-4486-b529-c8ca6afea9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6443f1b3-1de9-4486-b529-c8ca6afea9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-660551070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cadfec-3c3f-4489-80d4-8d8c84c5147d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14680a7ee0249489acec45e73e590e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:17Z,use_quota=True,user_id='329d5e46721c4f639d4726bb31ff8a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d87db5e-54c1-4dc6-ac8a-f39b7c462c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d87db5e-54c1-4dc6-ac8a-f39b7c462c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbee2863-e335-49ee-9cf4-de4dc47de18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbee2863-e335-49ee-9cf4-de4dc47de18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45cadfec-3c3f-4489-80d4-8d8c84c5147d', 'volume_name': 'volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0abab0-3b74-4153-948c-ce2b0be39882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0abab0-3b74-4153-948c-ce2b0be39882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e032533f-8a34-46b9-abba-1fa6161767e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:17 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Volume 45cadfec-3c3f-4489-80d4-8d8c84c5147d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d', 'volume_size': 1}
Apr 29 08:33:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:18 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:18 devstack cinder-volume[83885]: INFO oslo.privsep.daemon [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Spawned new privsep daemon via rootwrap
Apr 29 08:33:18 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Accepted privsep connection to /tmp/tmp60fvomfx/privsep.sock {{(pid=83885) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Apr 29 08:33:18 devstack cinder-volume[83885]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 29 08:33:18 devstack cinder-volume[83885]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 29 08:33:18 devstack cinder-volume[83885]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 29 08:33:18 devstack cinder-volume[83885]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84946
Apr 29 08:33:18 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b4bfb-11b4-4c09-b2f3-a8ead0dfcbd2]: (2,) {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:18 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cc7e7f-1ad7-4405-bf60-70c84c51224c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:18 devstack sudo[84949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508
Apr 29 08:33:18 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:19 devstack cinder-volume[83885]: WARNING py.warnings [req-16235223-8d3f-4bef-9969-58a7b79454d8 req-6fd7138d-bda5-4f33-bc97-4cbbb5279061 tempest-DeleteServersTestJSON-626164797 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Apr 29 08:33:19 devstack cinder-volume[83885]:   .first()
Apr 29 08:33:19 devstack cinder-volume[83885]: 
Apr 29 08:33:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-16235223-8d3f-4bef-9969-58a7b79454d8 req-6fd7138d-bda5-4f33-bc97-4cbbb5279061 tempest-DeleteServersTestJSON-626164797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:19 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508" returned: 0 in 0.960s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:19 devstack sudo[84965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 1G
Apr 29 08:33:19 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:20 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 1G" returned: 0 in 0.999s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276e847f-8c16-4240-a0c7-1def390d7508 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:20 devstack sudo[84973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276e847f-8c16-4240-a0c7-1def390d7508 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2
Apr 29 08:33:20 devstack sudo[84973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:21 devstack sudo[84973]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276e847f-8c16-4240-a0c7-1def390d7508 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2" returned: 0 in 0.881s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:21 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:33:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:21 devstack sudo[84979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2
Apr 29 08:33:21 devstack sudo[84979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:22 devstack sudo[84979]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2" returned: 0 in 0.639s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:22 devstack sudo[84982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.info
Apr 29 08:33:22 devstack sudo[84982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:22 devstack sudo[84982]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.info" returned: 0 in 0.672s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:22 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:33:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:22 devstack sudo[84987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.info
Apr 29 08:33:22 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:23 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.info" returned: 0 in 0.964s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.435s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.692s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-660551070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cadfec-3c3f-4489-80d4-8d8c84c5147d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14680a7ee0249489acec45e73e590e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:17Z,use_quota=True,user_id='329d5e46721c4f639d4726bb31ff8a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Creating volume 45cadfec-3c3f-4489-80d4-8d8c84c5147d {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:33:23 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:33:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:23 devstack sudo[84992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d 1073741824
Apr 29 08:33:23 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:23 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-394fb703-8647-47ac-8d6a-7014c58db73b tempest-GroupSnapshotsV319Test-1959004423 None] group_snapshot cdd833b1-3c4d-47af-9e48-9fa9d1c71624: created successfully
Apr 29 08:33:25 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d 1073741824" returned: 0 in 1.436s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:25 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] group_snapshot cdd833b1-3c4d-47af-9e48-9fa9d1c71624: deleting
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] group_snapshot cdd833b1-3c4d-47af-9e48-9fa9d1c71624: deleting {{(pid=83885) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 08:33:25 devstack sudo[85000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d
Apr 29 08:33:25 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Acquiring lock "cinder-quobyte-276e847f-8c16-4240-a0c7-1def390d7508" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Lock "cinder-quobyte-276e847f-8c16-4240-a0c7-1def390d7508" acquired by "delete_snapshot" :: waited 0.042s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Acquiring lock "cinder-quobyte-49d89ca3-2d6e-4a32-be37-945189a034d2" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Lock "cinder-quobyte-49d89ca3-2d6e-4a32-be37-945189a034d2" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Deleting offline snapshot 49d89ca3-2d6e-4a32-be37-945189a034d2 of volume 276e847f-8c16-4240-a0c7-1def390d7508 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] snapshot_file for this snap is: volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f42cae1-7522-4350-ac41-c0fbe713cc50]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:26 devstack sudo[85002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2
Apr 29 08:33:26 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:27 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2" returned: 0 in 1.552s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-276e847f-8c16-4240-a0c7-1def390d7508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[05469157-7f01-4380-8aed-ae5f8e8d3fba]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:27 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d" returned: 0 in 2.012s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] <== create_volume: return (3605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.611s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-16235223-8d3f-4bef-9969-58a7b79454d8 req-6fd7138d-bda5-4f33-bc97-4cbbb5279061 tempest-DeleteServersTestJSON-626164797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.257s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e032533f-8a34-46b9-abba-1fa6161767e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c9bef4-2188-4011-84e2-e67090274255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7177eb6d-2283-4355-bc1c-d98a2f1ada11]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-16235223-8d3f-4bef-9969-58a7b79454d8 req-6fd7138d-bda5-4f33-bc97-4cbbb5279061 tempest-DeleteServersTestJSON-626164797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:27 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Volume volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d (45cadfec-3c3f-4489-80d4-8d8c84c5147d): created successfully
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c9bef4-2188-4011-84e2-e67090274255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:27 devstack sudo[85010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508
Apr 29 08:33:27 devstack sudo[85010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Flow 'volume_create_manager' (3b54c1dc-8e3a-41c1-9710-d5426476f4f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:27 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-03e158e0-9e5a-40ff-9c3c-629376ee9f9d tempest-ServerRescueNegativeTestJSON-336061316 None] Created volume successfully.
Apr 29 08:33:27 devstack sudo[85011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec
Apr 29 08:33:27 devstack sudo[85011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:28 devstack sudo[85011]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-16235223-8d3f-4bef-9969-58a7b79454d8 req-6fd7138d-bda5-4f33-bc97-4cbbb5279061 tempest-DeleteServersTestJSON-626164797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec" returned: 0 in 1.355s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-16235223-8d3f-4bef-9969-58a7b79454d8 req-6fd7138d-bda5-4f33-bc97-4cbbb5279061 tempest-DeleteServersTestJSON-626164797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.411s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-16235223-8d3f-4bef-9969-58a7b79454d8 req-6fd7138d-bda5-4f33-bc97-4cbbb5279061 tempest-DeleteServersTestJSON-626164797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9', 'name': 'volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8141239-60be-489d-a59a-7c92a4097e0d', 'enforce_multipath': True} {{(pid=83885) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 08:33:29 devstack sudo[85010]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508" returned: 0 in 1.661s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:29 devstack sudo[85058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2
Apr 29 08:33:29 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-16235223-8d3f-4bef-9969-58a7b79454d8 req-6fd7138d-bda5-4f33-bc97-4cbbb5279061 tempest-DeleteServersTestJSON-626164797 None] attachment_update completed successfully.
Apr 29 08:33:30 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2" returned: 0 in 1.100s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:30 devstack sudo[85131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2
Apr 29 08:33:30 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:30 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508.49d89ca3-2d6e-4a32-be37-945189a034d2" returned: 0 in 0.708s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Lock "cinder-quobyte-49d89ca3-2d6e-4a32-be37-945189a034d2" released by "_delete_snapshot" :: held 5.269s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Lock "cinder-quobyte-276e847f-8c16-4240-a0c7-1def390d7508" released by "delete_snapshot" :: held 5.354s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:31 devstack cinder-volume[83885]: WARNING cinder.quota [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1691100144 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1691100144, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:33:31 devstack cinder-volume[83885]: WARNING cinder.quota [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1691100144 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1691100144, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:33:31 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] Created reservations ['400b1700-dea6-427f-82cd-43156bf86e0f', 'ad0a7103-e61e-4631-a34e-7232a088195b', '1ae38e15-a714-4fd8-a025-6baaae344a98', '1115a0dc-a441-4b46-a78f-297da7d81378'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:33:31 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0c3448f7-394c-48a5-be88-212fda8053c3 tempest-GroupSnapshotsV319Test-1959004423 None] group_snapshot cdd833b1-3c4d-47af-9e48-9fa9d1c71624: deleted successfully
Apr 29 08:33:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Acquiring lock "cinder-quobyte-276e847f-8c16-4240-a0c7-1def390d7508" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Lock "cinder-quobyte-276e847f-8c16-4240-a0c7-1def390d7508" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:31 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[491bce77-21d5-44d1-b0b3-6ddf372d78f9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:32 devstack sudo[85456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508
Apr 29 08:33:32 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:32 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508" returned: 0 in 0.989s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:32 devstack sudo[85492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508
Apr 29 08:33:32 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:33 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-276e847f-8c16-4240-a0c7-1def390d7508" returned: 0 in 0.725s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Lock "cinder-quobyte-276e847f-8c16-4240-a0c7-1def390d7508" released by "delete_volume" :: held 1.812s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Created reservations ['000bd1fa-98de-4cb0-aa34-a7fe84d89c05'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:33:33 devstack cinder-volume[83885]: WARNING cinder.quota [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1691100144 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1691100144, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Created reservations ['651fbfbd-d908-4233-8a2e-6a109f4303a2', 'd2045a3e-7abf-4702-b507-ea31244c4386', 'f32e5538-3601-466e-9228-7b8d6bb66836', '7530fd1a-dd2f-46de-a920-a2b9339389b8'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:33 devstack sudo[85502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:33:33 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:34 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.724s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:34 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:33:34 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d7b05cce-819c-4fd9-a656-e4c18e2db18e tempest-GroupSnapshotsV319Test-1959004423 None] Delete group completed successfully.
Apr 29 08:33:38 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-77668a22-6f27-427d-bc9e-104a13379b19 req-43a3ab4e-54be-4aec-acab-8e67b70d6769 tempest-DeleteServersTestJSON-626164797 None] Terminate volume connection completed successfully.
Apr 29 08:33:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-77668a22-6f27-427d-bc9e-104a13379b19 req-43a3ab4e-54be-4aec-acab-8e67b70d6769 tempest-DeleteServersTestJSON-626164797 None] Deleting attachment f8141239-60be-489d-a59a-7c92a4097e0d. {{(pid=83885) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 08:33:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Acquiring lock "cinder-2252f7c8-78e7-40c0-abb6-2d4816bb40ec-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Lock "cinder-2252f7c8-78e7-40c0-abb6-2d4816bb40ec-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Acquiring lock "cinder-quobyte-2252f7c8-78e7-40c0-abb6-2d4816bb40ec" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Lock "cinder-quobyte-2252f7c8-78e7-40c0-abb6-2d4816bb40ec" acquired by "delete_volume" :: waited 0.112s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:43 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16fbbdf-4670-4804-92f4-eb6f814b319d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:43 devstack sudo[85634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec
Apr 29 08:33:43 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:44 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec" returned: 0 in 1.325s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:44 devstack sudo[85639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec
Apr 29 08:33:44 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:45 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2252f7c8-78e7-40c0-abb6-2d4816bb40ec" returned: 0 in 1.014s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Lock "cinder-quobyte-2252f7c8-78e7-40c0-abb6-2d4816bb40ec" released by "delete_volume" :: held 2.447s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:45 devstack cinder-volume[83885]: WARNING cinder.quota [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:33:45 devstack cinder-volume[83885]: WARNING cinder.quota [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:33:45 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Created reservations ['1d6b9b39-0f0f-4a05-af58-a682f763d9ec', '1a5425b9-3737-4288-873b-b1fb55cc15ed', '59a56fd4-fdc8-4015-9f69-627f731adfe7', 'b35c09b8-e9b7-4e0f-9886-b1669ba24ac4'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:33:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:46 devstack sudo[85642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:33:46 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:47 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.118s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:47 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:33:47 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Deleted volume successfully.
Apr 29 08:33:47 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f5da0fe-b717-4578-a85d-1b92635b0d3b tempest-DeleteServersTestJSON-626164797 None] Lock "cinder-2252f7c8-78e7-40c0-abb6-2d4816bb40ec-delete_volume" released by "delete_volume" :: held 3.989s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:33:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:49 devstack sudo[85729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:33:49 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:50 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.907s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:33:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Acquiring lock "cinder-45cadfec-3c3f-4489-80d4-8d8c84c5147d-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "cinder-45cadfec-3c3f-4489-80d4-8d8c84c5147d-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Acquiring lock "cinder-quobyte-45cadfec-3c3f-4489-80d4-8d8c84c5147d" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "cinder-quobyte-45cadfec-3c3f-4489-80d4-8d8c84c5147d" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:52 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[619112f9-af44-42e5-b2ae-442fe297277d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:52 devstack sudo[85734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d
Apr 29 08:33:52 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:54 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d" returned: 0 in 1.214s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:54 devstack sudo[85741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d
Apr 29 08:33:54 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:55 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-45cadfec-3c3f-4489-80d4-8d8c84c5147d" returned: 0 in 1.061s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "cinder-quobyte-45cadfec-3c3f-4489-80d4-8d8c84c5147d" released by "delete_volume" :: held 2.370s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Created reservations ['010eb9fd-a50e-494c-ad72-4ebf599ce0c2', '1ab32c93-6b1c-450f-8c8b-47b1128837f9', '46d4c158-1a7c-4be0-87f7-b903bfcf8240', '42d6b45c-a8fd-423a-83a2-75cf60e864c4'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=49,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=4 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:55 devstack sudo[85745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:33:55 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:56 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.326s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:56 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:33:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Deleted volume successfully.
Apr 29 08:33:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4178b5a-8ab5-4cd1-a232-31fcbb935ef8 tempest-ServerRescueNegativeTestJSON-336061316 None] Lock "cinder-45cadfec-3c3f-4489-80d4-8d8c84c5147d-delete_volume" released by "delete_volume" :: held 4.145s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:56 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=44,cinder:UPDATE=46,cinder:INSERT=10 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:33:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-87faf6b0-5908-4a33-8b42-9df303eee9b3 tempest-GroupsV314Test-1660102218 None] Group tempest-GroupsV314Test-Group-195919706: creating
Apr 29 08:33:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-87faf6b0-5908-4a33-8b42-9df303eee9b3 tempest-GroupsV314Test-1660102218 None] Group tempest-GroupsV314Test-Group-195919706: created successfully
Apr 29 08:33:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-87faf6b0-5908-4a33-8b42-9df303eee9b3 tempest-GroupsV314Test-1660102218 None] Create group completed successfully.
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Flow 'volume_create_manager' (0a19a753-8fa1-403e-a1c5-30c954d29efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c0b548-5b72-469e-ac74-32cdddb004d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c0b548-5b72-469e-ac74-32cdddb004d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508711642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92500724-0492-4edf-8d3c-eefd9c83472f,host='devstack@QuobyteHD#QuobyteHD',id=735728a6-0025-4d3c-9546-b415cf980c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417ba5cc0de54e30b8952d654462d1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:59Z,use_quota=True,user_id='4cf68e65ae9d43eb9912d0ebf217a480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cd1a9a0-6dd5-4828-b7dd-7ee87b2dbba7),volume_type_id=0cd1a9a0-6dd5-4828-b7dd-7ee87b2dbba7)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516edc5e-e4e9-4c33-88a2-541b9225a2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516edc5e-e4e9-4c33-88a2-541b9225a2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5aaead8-f18e-4e66-828e-d37ac7fb2d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5aaead8-f18e-4e66-828e-d37ac7fb2d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735728a6-0025-4d3c-9546-b415cf980c32', 'volume_name': 'volume-735728a6-0025-4d3c-9546-b415cf980c32', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5694d8-e695-4605-a942-e4a9fa1b04f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5694d8-e695-4605-a942-e4a9fa1b04f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7213b31-a5eb-481d-8edb-38deb97980b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:59 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Volume 735728a6-0025-4d3c-9546-b415cf980c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735728a6-0025-4d3c-9546-b415cf980c32', 'volume_size': 1}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=92500724-0492-4edf-8d3c-eefd9c83472f,created_at=2026-04-29T06:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508711642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92500724-0492-4edf-8d3c-eefd9c83472f,host='devstack@QuobyteHD#QuobyteHD',id=735728a6-0025-4d3c-9546-b415cf980c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417ba5cc0de54e30b8952d654462d1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:59Z,use_quota=True,user_id='4cf68e65ae9d43eb9912d0ebf217a480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cd1a9a0-6dd5-4828-b7dd-7ee87b2dbba7),volume_type_id=0cd1a9a0-6dd5-4828-b7dd-7ee87b2dbba7)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Creating volume 735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:33:59 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:33:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:59 devstack sudo[85788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 1073741824
Apr 29 08:33:59 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:00 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 1073741824" returned: 0 in 1.485s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:01 devstack sudo[85794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32
Apr 29 08:34:01 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:01 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32" returned: 0 in 0.861s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:34:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.409s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7213b31-a5eb-481d-8edb-38deb97980b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735728a6-0025-4d3c-9546-b415cf980c32', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758944b4-97b1-472a-a77a-9c8fc3c6ed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:01 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Volume volume-735728a6-0025-4d3c-9546-b415cf980c32 (735728a6-0025-4d3c-9546-b415cf980c32): created successfully
Apr 29 08:34:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758944b4-97b1-472a-a77a-9c8fc3c6ed88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Flow 'volume_create_manager' (0a19a753-8fa1-403e-a1c5-30c954d29efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-1238ab66-5f2e-4d26-b02d-b79f0e722e1c tempest-GroupsV314Test-1660102218 None] Created volume successfully.
Apr 29 08:34:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:04 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Cloning volume 735728a6-0025-4d3c-9546-b415cf980c32 to volume fa6f0688-8026-4740-a5db-842ee4c64303
Apr 29 08:34:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Creating offline snapshot d3167f38-05d9-4f83-99ed-56d5e93c6a15 of volume 735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:34:04 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0eaeb4-1241-40dd-b5d8-ca7bd99dcdf7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:04 devstack sudo[85801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32
Apr 29 08:34:04 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:05 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32" returned: 0 in 0.863s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:05 devstack sudo[85807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 1G
Apr 29 08:34:05 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:06 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 1G" returned: 0 in 1.017s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735728a6-0025-4d3c-9546-b415cf980c32 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:06 devstack sudo[85813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735728a6-0025-4d3c-9546-b415cf980c32 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15
Apr 29 08:34:06 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:07 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735728a6-0025-4d3c-9546-b415cf980c32 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15" returned: 0 in 0.860s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:07 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:34:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:07 devstack sudo[85819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15
Apr 29 08:34:07 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:08 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15" returned: 0 in 0.900s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:08 devstack sudo[85822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.info
Apr 29 08:34:08 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:09 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.info" returned: 0 in 1.091s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:09 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:34:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:09 devstack sudo[85825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.info
Apr 29 08:34:09 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:09 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.info" returned: 0 in 0.809s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Acquiring lock "cinder-quobyte-fa6f0688-8026-4740-a5db-842ee4c64303" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Lock "cinder-quobyte-fa6f0688-8026-4740-a5db-842ee4c64303" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] snapshot: d3167f38-05d9-4f83-99ed-56d5e93c6a15, volume: fa6f0688-8026-4740-a5db-842ee4c64303,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:34:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:10 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[341b3d1c-8a1e-4a39-8575-afc690600da4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:10 devstack sudo[85828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15
Apr 29 08:34:10 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:11 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15" returned: 0 in 1.004s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735728a6-0025-4d3c-9546-b415cf980c32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:34:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:34:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:34:11 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ea072a-c839-49f6-a4e0-6d856a3c89be]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:11 devstack sudo[85872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32
Apr 29 08:34:11 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:12 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32" returned: 0 in 0.908s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:12 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303 not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:34:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:12 devstack sudo[85877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303
Apr 29 08:34:12 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:17 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303" returned: 0 in 5.899s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:17 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cc985b-4dce-46c1-a7c2-6a5229dd2bb7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:18 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:DELETE=2,cinder:SELECT=10,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:34:18 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:34:18 devstack sudo[85943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32
Apr 29 08:34:18 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:18 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32" returned: 0 in 0.846s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:18 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:34:18 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Converted 1024.00 MB image at 173.56 MB/s
Apr 29 08:34:18 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:34:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:18 devstack sudo[85949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303
Apr 29 08:34:18 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:19 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303" returned: 0 in 0.604s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Lock "cinder-quobyte-fa6f0688-8026-4740-a5db-842ee4c64303" released by "_copy_volume_from_snapshot" :: held 9.394s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Acquiring lock "cinder-quobyte-d3167f38-05d9-4f83-99ed-56d5e93c6a15" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Lock "cinder-quobyte-d3167f38-05d9-4f83-99ed-56d5e93c6a15" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Deleting offline snapshot d3167f38-05d9-4f83-99ed-56d5e93c6a15 of volume 735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:34:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] snapshot_file for this snap is: volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:34:21 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65f9aed-1f73-4363-b3e3-fcfd9b7980d0]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:21 devstack sudo[85952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15
Apr 29 08:34:21 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:22 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15" returned: 0 in 1.083s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735728a6-0025-4d3c-9546-b415cf980c32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:34:22 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f2e47-642b-4c10-9644-96831adb79fc]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:22 devstack sudo[85958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32
Apr 29 08:34:22 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:23 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32" returned: 0 in 0.806s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:23 devstack sudo[85965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15
Apr 29 08:34:23 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:23 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15" returned: 0 in 0.938s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:24 devstack sudo[85973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15
Apr 29 08:34:24 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:24 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32.d3167f38-05d9-4f83-99ed-56d5e93c6a15" returned: 0 in 0.761s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Lock "cinder-quobyte-d3167f38-05d9-4f83-99ed-56d5e93c6a15" released by "_delete_snapshot" :: held 3.751s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.584s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:24 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-401ed91f-7a73-484d-8a7a-d8d1f35a46df tempest-GroupsV314Test-1660102218 None] Create group from source-group-92500724-0492-4edf-8d3c-eefd9c83472f completed successfully.
Apr 29 08:34:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Acquiring lock "cinder-quobyte-fa6f0688-8026-4740-a5db-842ee4c64303" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Lock "cinder-quobyte-fa6f0688-8026-4740-a5db-842ee4c64303" acquired by "delete_volume" :: waited 0.039s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:26 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[52df627b-ef61-4341-906a-f678a3b46ac5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:26 devstack sudo[85978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303
Apr 29 08:34:26 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:26 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303" returned: 0 in 0.836s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:26 devstack sudo[85985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303
Apr 29 08:34:26 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:27 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa6f0688-8026-4740-a5db-842ee4c64303" returned: 0 in 0.686s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Lock "cinder-quobyte-fa6f0688-8026-4740-a5db-842ee4c64303" released by "delete_volume" :: held 1.586s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Created reservations ['681b1843-8ad2-49ad-b2fc-e3e76b7e1b26'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:34:27 devstack cinder-volume[83885]: WARNING cinder.quota [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1197312978 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1197312978, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:34:27 devstack cinder-volume[83885]: WARNING cinder.quota [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1197312978 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1197312978, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Created reservations ['0474c84d-bb82-4981-99f4-88d955c659df', '7d6e083e-b89e-40c5-af0d-ec5083b92dcb', '22779e3e-d843-4080-a71c-4817e543e75b', '5e9c277c-41b2-4cf1-b7ab-9a6a729322d7'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:27 devstack sudo[85988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:34:27 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Acquiring lock "cinder-quobyte-735728a6-0025-4d3c-9546-b415cf980c32" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Lock "cinder-quobyte-735728a6-0025-4d3c-9546-b415cf980c32" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:28 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.812s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:28 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:34:28 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-61859f33-7371-4d44-a4d4-3ee1e5d1fbbb tempest-GroupsV314Test-1660102218 None] Delete group completed successfully.
Apr 29 08:34:28 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a012a55-037b-4f82-b22d-6634381f3985]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:28 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32
Apr 29 08:34:28 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:29 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32" returned: 0 in 0.967s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:29 devstack sudo[85997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32
Apr 29 08:34:29 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:30 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-735728a6-0025-4d3c-9546-b415cf980c32" returned: 0 in 0.785s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Lock "cinder-quobyte-735728a6-0025-4d3c-9546-b415cf980c32" released by "delete_volume" :: held 1.854s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Created reservations ['8bd2bda5-5c42-49e3-90c3-9d21a2eb4dcc'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Created reservations ['85872af9-7c75-4395-9e39-99d98b376404', 'c663d5b5-938d-48ec-8eb4-c3d2433d70b7', '82192361-48b4-4c40-8b33-b8b64d3a4757', 'db548190-f448-40f7-9f9b-5607c1d2c24a'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:30 devstack sudo[86023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:34:30 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:31 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.861s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:31 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:34:31 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a811001c-c8a6-44ac-b461-5b2b01a4fae5 tempest-GroupsV314Test-1660102218 None] Delete group completed successfully.
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Flow 'volume_create_manager' (e81a3388-6b6b-47e5-ace8-a3975ccab0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d175cca7-ec71-48a5-9dd8-f9c849c86f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d175cca7-ec71-48a5-9dd8-f9c849c86f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1183270979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda890d2-449c-4c10-953b-7bdc4f297bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cc49c29cf8465891677cf883e1b760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:38Z,use_quota=True,user_id='9084b7a84ef247eca3cd66a62c3db79b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3656e24e-c5c1-44c7-b3dd-ddbbc3525923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3656e24e-c5c1-44c7-b3dd-ddbbc3525923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f28d1fd-1c2a-4bfb-bb94-c18abe50cbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f28d1fd-1c2a-4bfb-bb94-c18abe50cbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda890d2-449c-4c10-953b-7bdc4f297bc1', 'volume_name': 'volume-fda890d2-449c-4c10-953b-7bdc4f297bc1', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624a0990-e9cb-4975-8781-b8ae696d078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624a0990-e9cb-4975-8781-b8ae696d078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f19dd04-b488-4f9f-bbad-53f0037c365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Volume fda890d2-449c-4c10-953b-7bdc4f297bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda890d2-449c-4c10-953b-7bdc4f297bc1', 'volume_size': 1}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1183270979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda890d2-449c-4c10-953b-7bdc4f297bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cc49c29cf8465891677cf883e1b760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:38Z,use_quota=True,user_id='9084b7a84ef247eca3cd66a62c3db79b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Creating volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:34:38 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:34:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:38 devstack sudo[86036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 1073741824
Apr 29 08:34:38 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:39 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 1073741824" returned: 0 in 0.848s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:39 devstack sudo[86042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1
Apr 29 08:34:39 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:40 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1" returned: 0 in 0.962s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f19dd04-b488-4f9f-bbad-53f0037c365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda890d2-449c-4c10-953b-7bdc4f297bc1', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74809bf-1d3a-4ddf-96f6-2290477f56bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:40 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Volume volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 (fda890d2-449c-4c10-953b-7bdc4f297bc1): created successfully
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74809bf-1d3a-4ddf-96f6-2290477f56bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Flow 'volume_create_manager' (e81a3388-6b6b-47e5-ace8-a3975ccab0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:40 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-892c87a1-1b45-48b5-93e8-afaa56639aa3 tempest-SnapshotsActionsTest-47070833 None] Created volume successfully.
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Creating offline snapshot 663cdeec-e9b4-4136-a1e0-4e0f6793729b of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ed65c0-84ce-4f5d-b703-143ef850c0f1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:41 devstack sudo[86106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1
Apr 29 08:34:41 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:42 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1" returned: 0 in 1.589s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:42 devstack sudo[86118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b 1G
Apr 29 08:34:42 devstack sudo[86118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:44 devstack sudo[86118]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b 1G" returned: 0 in 1.587s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:44 devstack sudo[86141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:34:44 devstack sudo[86141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:45 devstack sudo[86141]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 1.173s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:45 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b is being set with open permissions: ugo+rw
Apr 29 08:34:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:45 devstack sudo[86146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:34:45 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:46 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 0.905s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:46 devstack sudo[86150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.info
Apr 29 08:34:46 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:47 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.info" returned: 0 in 1.087s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:47 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.info is being set with open permissions: ugo+rw
Apr 29 08:34:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:47 devstack sudo[86154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.info
Apr 29 08:34:47 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:48 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.info" returned: 0 in 1.037s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.560s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:48 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3a4003e7-875b-40d8-a53a-7b13ed81cfac tempest-SnapshotsActionsTest-47070833 None] Create snapshot completed successfully
Apr 29 08:34:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:34:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:49 devstack sudo[86162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:34:49 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Creating offline snapshot 12d47d5d-5d38-45fa-9148-5664aa442d70 of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:34:50 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c482c037-5e16-413b-8397-627f1a213ac0]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:50 devstack sudo[86164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:34:50 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:50 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.063s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:34:51 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 1.282s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:34:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:51 devstack sudo[86230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 1G
Apr 29 08:34:51 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:52 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 1G" returned: 0 in 1.124s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:52 devstack sudo[86254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70
Apr 29 08:34:52 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:53 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70" returned: 0 in 0.680s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:53 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 is being set with open permissions: ugo+rw
Apr 29 08:34:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:53 devstack sudo[86265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70
Apr 29 08:34:53 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:54 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70" returned: 0 in 0.596s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.822s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-613d7d9e-75d3-4e77-85fc-243e5947f9ee tempest-SnapshotsActionsTest-47070833 None] Create snapshot completed successfully
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-12d47d5d-5d38-45fa-9148-5664aa442d70-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-12d47d5d-5d38-45fa-9148-5664aa442d70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-quobyte-12d47d5d-5d38-45fa-9148-5664aa442d70" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-12d47d5d-5d38-45fa-9148-5664aa442d70" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Deleting offline snapshot 12d47d5d-5d38-45fa-9148-5664aa442d70 of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] snapshot_file for this snap is: volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[727c88d7-0c20-4f96-a6b3-fddb9d280832]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:57 devstack sudo[86325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70
Apr 29 08:34:57 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:58 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70" returned: 0 in 1.122s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:34:58 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[9035cc14-81ca-434d-88b6-1896ce954a47]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:58 devstack sudo[86333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:34:58 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:59 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 0.923s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:34:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:59 devstack sudo[86338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70
Apr 29 08:34:59 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Flow 'volume_create_manager' (0a3ee73c-4e30-48e0-9a3b-9d17deb3204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1154f3e-c069-4496-ad5a-8a004794b1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1154f3e-c069-4496-ad5a-8a004794b1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1525150961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b53ed0-5fac-4de4-9d93-93fc7a62ab64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4437d12c1f12422d8bd9fabfc948f5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:00Z,use_quota=True,user_id='a923cd10dddd48d2a7e2e5a4d71d8de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601d68f6-2330-49f2-85b0-2a2e82718d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601d68f6-2330-49f2-85b0-2a2e82718d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6ec76a-210c-4bd5-bfcc-c5706547c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6ec76a-210c-4bd5-bfcc-c5706547c01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b53ed0-5fac-4de4-9d93-93fc7a62ab64', 'volume_name': 'volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4346c5e-2914-47ba-948c-8468ff92d8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4346c5e-2914-47ba-948c-8468ff92d8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e2415a-8b93-4f46-be9c-b5e191d21744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:00 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Volume 13b53ed0-5fac-4de4-9d93-93fc7a62ab64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64', 'volume_size': 1}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1525150961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b53ed0-5fac-4de4-9d93-93fc7a62ab64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4437d12c1f12422d8bd9fabfc948f5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:00Z,use_quota=True,user_id='a923cd10dddd48d2a7e2e5a4d71d8de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Creating volume 13b53ed0-5fac-4de4-9d93-93fc7a62ab64 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:00 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:00 devstack sudo[86340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64 1073741824
Apr 29 08:35:00 devstack sudo[86340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:00 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70" returned: 0 in 1.111s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:00 devstack sudo[86347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70
Apr 29 08:35:00 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:01 devstack sudo[86340]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64 1073741824" returned: 0 in 1.108s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:01 devstack sudo[86357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64
Apr 29 08:35:01 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:01 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.12d47d5d-5d38-45fa-9148-5664aa442d70" returned: 0 in 1.302s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-12d47d5d-5d38-45fa-9148-5664aa442d70" released by "_delete_snapshot" :: held 4.649s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" released by "delete_snapshot" :: held 4.707s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:02 devstack cinder-volume[83885]: WARNING cinder.quota [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Created reservations ['a4999699-0309-4224-bf66-f03fd11d2554', '1c181ff4-2111-415b-9b3b-7b7856181fde', 'f25c3ca3-4e24-4fc9-bd5a-0bda5327495c', '337e28ae-337b-4f3a-92ee-92c9718d3389'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Delete snapshot completed successfully.
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7ea854d-ffdf-4c7a-8374-83b892cbb56a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-12d47d5d-5d38-45fa-9148-5664aa442d70-delete_snapshot" released by "delete_snapshot" :: held 5.102s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:02 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64" returned: 0 in 1.302s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] <== create_volume: return (2540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.542s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e2415a-8b93-4f46-be9c-b5e191d21744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b326824-59e8-4a60-93a4-dea7aa1f1b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:02 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Volume volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64 (13b53ed0-5fac-4de4-9d93-93fc7a62ab64): created successfully
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b326824-59e8-4a60-93a4-dea7aa1f1b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Flow 'volume_create_manager' (0a3ee73c-4e30-48e0-9a3b-9d17deb3204f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-47b32f13-3fd7-45e2-b14d-5b60de701c76 tempest-VolumesAdminNegativeTest-1694185848 None] Created volume successfully.
Apr 29 08:35:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Creating offline snapshot 7d1762c2-5963-47a4-8237-4b431b6c511d of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:35:03 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8fe06-9fa3-4dd3-bf0e-f3a2f17447de]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:04 devstack sudo[86366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:35:04 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Acquiring lock "cinder-13b53ed0-5fac-4de4-9d93-93fc7a62ab64-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Lock "cinder-13b53ed0-5fac-4de4-9d93-93fc7a62ab64-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Acquiring lock "cinder-quobyte-13b53ed0-5fac-4de4-9d93-93fc7a62ab64" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Lock "cinder-quobyte-13b53ed0-5fac-4de4-9d93-93fc7a62ab64" acquired by "delete_volume" :: waited 0.058s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:05 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[8132f374-2256-4784-8655-53b1c2aeb120]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:05 devstack sudo[86380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64
Apr 29 08:35:05 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:05 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 1.980s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:05 devstack sudo[86386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d 1G
Apr 29 08:35:05 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:07 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64" returned: 0 in 1.711s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:07 devstack sudo[86397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64
Apr 29 08:35:07 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:07 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d 1G" returned: 0 in 1.471s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:07 devstack sudo[86401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d
Apr 29 08:35:07 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:07 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13b53ed0-5fac-4de4-9d93-93fc7a62ab64" returned: 0 in 0.777s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Lock "cinder-quobyte-13b53ed0-5fac-4de4-9d93-93fc7a62ab64" released by "delete_volume" :: held 2.623s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:07 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Created reservations ['1e2efab3-941e-4513-993c-04fdc9e4ba74', 'dfeca31c-1243-47f3-9bfd-162884a28893', '87fceb54-f3fb-409b-ab0b-4ce172a81fc7', 'aaa1b7c4-c51f-4217-95fb-c420a24fcc12'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:08 devstack sudo[86407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:35:08 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:08 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d" returned: 0 in 1.027s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:08 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d is being set with open permissions: ugo+rw
Apr 29 08:35:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:08 devstack sudo[86409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d
Apr 29 08:35:08 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:09 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.079s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:09 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Deleted volume successfully.
Apr 29 08:35:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-030d79ce-8077-41dd-8381-32be374ff59a tempest-VolumesAdminNegativeTest-1694185848 None] Lock "cinder-13b53ed0-5fac-4de4-9d93-93fc7a62ab64-delete_volume" released by "delete_volume" :: held 4.094s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:09 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d" returned: 0 in 0.909s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.649s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-53bb86a0-41fc-4a7c-9505-802f2f5dde4b tempest-SnapshotsActionsTest-47070833 None] Create snapshot completed successfully
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-7d1762c2-5963-47a4-8237-4b431b6c511d-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-7d1762c2-5963-47a4-8237-4b431b6c511d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-quobyte-7d1762c2-5963-47a4-8237-4b431b6c511d" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-7d1762c2-5963-47a4-8237-4b431b6c511d" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Deleting offline snapshot 7d1762c2-5963-47a4-8237-4b431b6c511d of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] snapshot_file for this snap is: volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[9835d46b-ef07-4f3d-a802-ffb20bc4f573]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:10 devstack sudo[86488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d
Apr 29 08:35:10 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:11 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d" returned: 0 in 0.787s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:11 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fafd85-ae6a-4060-a6ae-a369dfc6f872]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:11 devstack sudo[86498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:35:11 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:12 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 1.498s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:12 devstack sudo[86561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d
Apr 29 08:35:12 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:13 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:35:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Flow 'volume_create_manager' (46254714-c28d-4fcd-bff1-58bee03f94ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d33a316-5f88-48bc-8344-7ccb681f3a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d33a316-5f88-48bc-8344-7ccb681f3a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:13Z,deleted=False,deleted_at=None,display_description='',display_name='362ea3b3-024e-411b-a63a-78f50281b32b-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18194838e1fc4ddfb4610c9e0b7e93ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:14Z,use_quota=True,user_id='003f72a5d5ec4d1cb35ac2e056df927d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25de436-b79d-4e89-8622-9229844279ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25de436-b79d-4e89-8622-9229844279ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5f654f-c52f-44f7-8ebc-1bf8a91f827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5f654f-c52f-44f7-8ebc-1bf8a91f827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426', 'volume_name': 'volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3508c3fc-754b-4a82-8c73-5d66c384f990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3508c3fc-754b-4a82-8c73-5d66c384f990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d794422-f69f-4e42-ad57-50ce053acbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:14 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Volume 2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426', 'volume_size': 1}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:13Z,deleted=False,deleted_at=None,display_description='',display_name='362ea3b3-024e-411b-a63a-78f50281b32b-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18194838e1fc4ddfb4610c9e0b7e93ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:14Z,use_quota=True,user_id='003f72a5d5ec4d1cb35ac2e056df927d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Creating volume 2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:14 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:14 devstack sudo[86570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426 1073741824
Apr 29 08:35:14 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:14 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d" returned: 0 in 1.382s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:14 devstack sudo[86572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d
Apr 29 08:35:14 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:14 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.7d1762c2-5963-47a4-8237-4b431b6c511d" returned: 0 in 0.748s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-7d1762c2-5963-47a4-8237-4b431b6c511d" released by "_delete_snapshot" :: held 4.555s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" released by "delete_snapshot" :: held 4.608s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:15 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:15 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Created reservations ['be246422-e228-427a-a4e4-7d8e19dbb8d4', '3e0f2869-b7af-4cb2-9676-d28949f70732', '665a6811-41cd-4c83-ac61-ea5a1a9066ec', '629169bf-c25d-4141-a6d6-4e57bb031059'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426 1073741824" returned: 0 in 0.997s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:15 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Delete snapshot completed successfully.
Apr 29 08:35:15 devstack sudo[86580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426
Apr 29 08:35:15 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cfde9b67-2030-4c47-a74a-7c64ee3dc3a4 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-7d1762c2-5963-47a4-8237-4b431b6c511d-delete_snapshot" released by "delete_snapshot" :: held 4.891s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:16 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426" returned: 0 in 1.069s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d794422-f69f-4e42-ad57-50ce053acbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0086b976-2d1f-4fae-b9bc-d6a103d2793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:16 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Volume volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426 (2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426): created successfully
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0086b976-2d1f-4fae-b9bc-d6a103d2793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Flow 'volume_create_manager' (46254714-c28d-4fcd-bff1-58bee03f94ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:16 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-ad774535-36ab-4640-8847-5c6be0278539 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Created volume successfully.
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Creating offline snapshot f3863bb7-d18f-47ca-89aa-5a5e810fdf3c of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91e707e-9ec4-4c48-b6b1-c8a87526f692]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:16 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:35:16 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:17 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 1.244s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:17 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c 1G
Apr 29 08:35:17 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-67edbe6b-cd86-4252-9a88-fa4f41f832a9 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:19 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c 1G" returned: 0 in 1.287s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:19 devstack sudo[86642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c
Apr 29 08:35:19 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:19 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c" returned: 0 in 0.761s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:19 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c is being set with open permissions: ugo+rw
Apr 29 08:35:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:19 devstack sudo[86647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c
Apr 29 08:35:19 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:20 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c" returned: 0 in 1.118s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.589s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-67edbe6b-cd86-4252-9a88-fa4f41f832a9 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.053s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:20 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[438594da-0ae3-41db-a69e-6ce251d425c6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-67edbe6b-cd86-4252-9a88-fa4f41f832a9 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:20 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ec12cf37-46ba-4c49-aba9-fb89aaac9e7a tempest-SnapshotsActionsTest-47070833 None] Create snapshot completed successfully
Apr 29 08:35:21 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426
Apr 29 08:35:21 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-f3863bb7-d18f-47ca-89aa-5a5e810fdf3c-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-f3863bb7-d18f-47ca-89aa-5a5e810fdf3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-quobyte-f3863bb7-d18f-47ca-89aa-5a5e810fdf3c" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-f3863bb7-d18f-47ca-89aa-5a5e810fdf3c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Deleting offline snapshot f3863bb7-d18f-47ca-89aa-5a5e810fdf3c of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] snapshot_file for this snap is: volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7f9fa-e632-447a-83a3-931e0cb029f7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:22 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-67edbe6b-cd86-4252-9a88-fa4f41f832a9 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426" returned: 0 in 1.327s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-67edbe6b-cd86-4252-9a88-fa4f41f832a9 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.353s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=62,cinder:SELECT=47,cinder:INSERT=14,cinder:DELETE=4 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=52,cinder:SELECT=59,cinder:INSERT=12,cinder:DELETE=4 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:35:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-67edbe6b-cd86-4252-9a88-fa4f41f832a9 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9', 'name': 'volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f63a5e7-0e30-4b46-94f1-465bf876135c', 'enforce_multipath': True} {{(pid=83885) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 08:35:22 devstack sudo[86671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c
Apr 29 08:35:22 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:22 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-71974e29-1a85-4f0e-af7e-557489d29a9f req-67edbe6b-cd86-4252-9a88-fa4f41f832a9 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] attachment_update completed successfully.
Apr 29 08:35:23 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c" returned: 0 in 1.385s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:23 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb05bda5-1657-45ac-862b-9f8a6c800d91]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:23 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:35:23 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:24 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 1.018s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:24 devstack sudo[86684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c
Apr 29 08:35:24 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:26 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c" returned: 0 in 1.353s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:26 devstack sudo[86759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c
Apr 29 08:35:26 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:26 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.f3863bb7-d18f-47ca-89aa-5a5e810fdf3c" returned: 0 in 0.792s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-f3863bb7-d18f-47ca-89aa-5a5e810fdf3c" released by "_delete_snapshot" :: held 4.716s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" released by "delete_snapshot" :: held 4.749s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:26 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Created reservations ['ad7ce637-ac1a-4bdc-9cb6-28b32aba5a6a', '8e818609-8e7c-4452-8d33-3c014d6c834a', 'de038731-43cd-48fb-a836-fa0b899314fd', 'b4f52e1f-709e-426f-b14f-affcdfc7b603'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:27 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Delete snapshot completed successfully.
Apr 29 08:35:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ee903b4e-fea2-4617-b411-319425e55749 tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-f3863bb7-d18f-47ca-89aa-5a5e810fdf3c-delete_snapshot" released by "delete_snapshot" :: held 4.977s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Creating offline snapshot 5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:35:28 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feb6396-02a5-46d2-815f-1595ae293300]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:28 devstack sudo[86812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:35:28 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:29 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 1.126s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:29 devstack sudo[87161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 1G
Apr 29 08:35:29 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:30 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 1G" returned: 0 in 1.033s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:30 devstack sudo[87170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7
Apr 29 08:35:30 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:31 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7" returned: 0 in 0.868s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:31 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 is being set with open permissions: ugo+rw
Apr 29 08:35:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:31 devstack sudo[87182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7
Apr 29 08:35:31 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:32 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7" returned: 0 in 0.699s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.869s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:32 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-efc9c1ec-dd1b-45e8-9d3f-a041d232a49d tempest-SnapshotsActionsTest-47070833 None] Create snapshot completed successfully
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Acquiring lock "cinder-quobyte-5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Deleting offline snapshot 5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] snapshot_file for this snap is: volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[96267ccc-adca-4d85-b317-b4bb57b3601d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:32 devstack sudo[87190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7
Apr 29 08:35:32 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:33 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7" returned: 0 in 1.033s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:33 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[97392e42-fe5f-4d38-b604-8bb999a3b976]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:33 devstack sudo[87231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:35:33 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:35 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 1.411s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:35 devstack sudo[87240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7
Apr 29 08:35:35 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:36 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7" returned: 0 in 1.662s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:36 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7
Apr 29 08:35:36 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:37 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7" returned: 0 in 1.181s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7" released by "_delete_snapshot" :: held 5.498s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" released by "delete_snapshot" :: held 5.532s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:38 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Created reservations ['7ad399f3-4335-4f16-b3f8-9f9d36ec774e', 'afc553b3-2297-4ef3-aa7f-4b282e8388f4', 'dd7223c4-df7b-4a61-ab57-93d8efb3ff56', '90075bbc-2886-49ed-8dfd-88c36ee10c95'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:38 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Delete snapshot completed successfully.
Apr 29 08:35:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a3c7a9af-c5bb-4638-a92d-6dd501a56c0a tempest-SnapshotsActionsTest-824830933 None] Lock "cinder-5fc91ceb-d5f2-4e3d-a2b5-5a31798a38b7-delete_snapshot" released by "delete_snapshot" :: held 5.718s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "cinder-663cdeec-e9b4-4136-a1e0-4e0f6793729b-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-663cdeec-e9b4-4136-a1e0-4e0f6793729b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "cinder-quobyte-663cdeec-e9b4-4136-a1e0-4e0f6793729b" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-quobyte-663cdeec-e9b4-4136-a1e0-4e0f6793729b" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Deleting offline snapshot 663cdeec-e9b4-4136-a1e0-4e0f6793729b of volume fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] snapshot_file for this snap is: volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[71761874-9f11-4f7f-97c4-afb926baa2b6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:39 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:35:39 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:40 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 1.048s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fda890d2-449c-4c10-953b-7bdc4f297bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:40 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2a5732-c8c2-4aec-847c-3c4ad0fe2917]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:41 devstack sudo[87338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1
Apr 29 08:35:41 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:41 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1" returned: 0 in 1.061s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:42 devstack sudo[87344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:35:42 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:42 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 0.859s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:42 devstack sudo[87369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b
Apr 29 08:35:42 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:35:43 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Flow 'volume_create_manager' (37decf69-813e-4271-ba5c-006dda354cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c31552-5113-45a9-8187-b51f8783e31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1.663cdeec-e9b4-4136-a1e0-4e0f6793729b" returned: 0 in 0.725s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c31552-5113-45a9-8187-b51f8783e31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-84207458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0317f608-2020-4652-9226-dd62bd1cd167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b33b32d569d45599c14ee34ac91db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:43Z,use_quota=True,user_id='b7436754db5f404493b361b7d05098cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fa6be5-3033-416b-b251-1a4d85c81b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65fa6be5-3033-416b-b251-1a4d85c81b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b318347-11de-4429-843c-57394057b575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b318347-11de-4429-843c-57394057b575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0317f608-2020-4652-9226-dd62bd1cd167', 'volume_name': 'volume-0317f608-2020-4652-9226-dd62bd1cd167', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3998e6b-bd18-4154-bcc1-65565eee5404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3998e6b-bd18-4154-bcc1-65565eee5404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b6629e-826d-41dd-b715-5e93369c9c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:43 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Volume 0317f608-2020-4652-9226-dd62bd1cd167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0317f608-2020-4652-9226-dd62bd1cd167', 'volume_size': 1}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-84207458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0317f608-2020-4652-9226-dd62bd1cd167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b33b32d569d45599c14ee34ac91db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:43Z,use_quota=True,user_id='b7436754db5f404493b361b7d05098cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Creating volume 0317f608-2020-4652-9226-dd62bd1cd167 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:43 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:43 devstack sudo[87373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167 1073741824
Apr 29 08:35:43 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-quobyte-663cdeec-e9b4-4136-a1e0-4e0f6793729b" released by "_delete_snapshot" :: held 3.925s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" released by "delete_snapshot" :: held 3.980s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Created reservations ['2e875d04-7c99-465e-b41e-906bef05d074', '6486bcdf-42b1-4774-8ded-749191e5bfc5', '85757389-a62e-4be2-bb3a-51f09419cc1c', 'f0ab65cb-5c69-4ec1-8981-25fdbae066ec'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:43 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Delete snapshot completed successfully.
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc29e9fb-beae-4c56-a7de-f8ca8fb0587d tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-663cdeec-e9b4-4136-a1e0-4e0f6793729b-delete_snapshot" released by "delete_snapshot" :: held 4.174s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "cinder-fda890d2-449c-4c10-953b-7bdc4f297bc1-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-fda890d2-449c-4c10-953b-7bdc4f297bc1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" acquired by "delete_volume" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:44 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0913a8d-0284-4847-b482-0a503d8a6899]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:44 devstack sudo[87375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1
Apr 29 08:35:44 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:44 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167 1073741824" returned: 0 in 0.926s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:44 devstack sudo[87380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167
Apr 29 08:35:44 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:44 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1" returned: 0 in 0.802s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:44 devstack sudo[87386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1
Apr 29 08:35:44 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:45 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167" returned: 0 in 0.707s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b6629e-826d-41dd-b715-5e93369c9c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0317f608-2020-4652-9226-dd62bd1cd167', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b9fd5d-4488-48f2-98ca-0e5e6aaa6760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Volume volume-0317f608-2020-4652-9226-dd62bd1cd167 (0317f608-2020-4652-9226-dd62bd1cd167): created successfully
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b9fd5d-4488-48f2-98ca-0e5e6aaa6760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Flow 'volume_create_manager' (37decf69-813e-4271-ba5c-006dda354cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:45 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-89b7a7b9-5f88-4b07-94e9-c2d03223d52c req-86c8996c-0d32-497c-9c1d-c538eb377d87 tempest-VolumesSnapshotsTestJSON-642240631 None] Created volume successfully.
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Flow 'volume_create_manager' (14f467f4-8ef7-41eb-b938-e96d4982c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b9c41b-4335-48eb-9362-9595e876274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b9c41b-4335-48eb-9362-9595e876274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1545396021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcea1d19-9490-4315-abcf-0cd1241da1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590eb9c0e04b462bae70f67185621c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:45Z,use_quota=True,user_id='5a7103df2f8447e599690729487e2421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8945e7e2-8a3b-4557-b0be-c70cf7671c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8945e7e2-8a3b-4557-b0be-c70cf7671c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461f1685-87a5-4039-adc9-46c755c484df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461f1685-87a5-4039-adc9-46c755c484df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcea1d19-9490-4315-abcf-0cd1241da1ff', 'volume_name': 'volume-dcea1d19-9490-4315-abcf-0cd1241da1ff', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4538d5a2-1ecf-4d56-b716-2125ce9b9d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4538d5a2-1ecf-4d56-b716-2125ce9b9d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a355631-7bfd-4769-a77e-9e109273f8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Volume dcea1d19-9490-4315-abcf-0cd1241da1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcea1d19-9490-4315-abcf-0cd1241da1ff', 'volume_size': 1}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1545396021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcea1d19-9490-4315-abcf-0cd1241da1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590eb9c0e04b462bae70f67185621c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:45Z,use_quota=True,user_id='5a7103df2f8447e599690729487e2421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Creating volume dcea1d19-9490-4315-abcf-0cd1241da1ff {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:45 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:45 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff 1073741824
Apr 29 08:35:45 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:45 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fda890d2-449c-4c10-953b-7bdc4f297bc1" returned: 0 in 0.714s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-quobyte-fda890d2-449c-4c10-953b-7bdc4f297bc1" released by "delete_volume" :: held 1.609s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Created reservations ['4c8124f6-a868-408d-88db-316f1a8b3695', 'de85edf7-0e1a-4a1c-82ac-c87542d1c4e6', '3ef9100a-d90a-46cf-94e5-6f35149dd181', '307ee6e8-7604-4c2e-8790-6212d340fdd4'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:45 devstack sudo[87417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:35:45 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:46 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff 1073741824" returned: 0 in 1.008s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:46 devstack sudo[87424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff
Apr 29 08:35:46 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:46 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.704s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:46 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:46 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Deleted volume successfully.
Apr 29 08:35:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81d0f79c-f78d-4d3c-b902-70cbfce9a60e tempest-SnapshotsActionsTest-47070833 None] Lock "cinder-fda890d2-449c-4c10-953b-7bdc4f297bc1-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:47 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff" returned: 0 in 0.844s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.311s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Creating offline snapshot 31e423b2-62a3-41fd-8c6f-29e97e080f8f of volume 0317f608-2020-4652-9226-dd62bd1cd167 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a355631-7bfd-4769-a77e-9e109273f8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcea1d19-9490-4315-abcf-0cd1241da1ff', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2e5574-4995-42ae-8f37-709105f263e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[16942021-8cac-40d8-ac87-165c5966174f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:47 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Volume volume-dcea1d19-9490-4315-abcf-0cd1241da1ff (dcea1d19-9490-4315-abcf-0cd1241da1ff): created successfully
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2e5574-4995-42ae-8f37-709105f263e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:47 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Flow 'volume_create_manager' (14f467f4-8ef7-41eb-b938-e96d4982c438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:47 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-cd71703b-cea0-43e4-8183-31b78b155009 tempest-ServersNegativeTestJSON-1309059733 None] Created volume successfully.
Apr 29 08:35:47 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167
Apr 29 08:35:47 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:48 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167" returned: 0 in 1.229s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:48 devstack sudo[87472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f 1G
Apr 29 08:35:48 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:35:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:49 devstack sudo[87478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:35:49 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:49 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f 1G" returned: 0 in 1.270s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0317f608-2020-4652-9226-dd62bd1cd167 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:50 devstack sudo[87480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0317f608-2020-4652-9226-dd62bd1cd167 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f
Apr 29 08:35:50 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Flow 'volume_create_manager' (3b1b5da0-78aa-407a-9bea-562f8342abec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55178bec-9dcc-4712-b530-38c7b5614535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55178bec-9dcc-4712-b530-38c7b5614535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1787914233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13261296-42f0-4e44-a37b-ce6491ffd0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590eb9c0e04b462bae70f67185621c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:51Z,use_quota=True,user_id='5a7103df2f8447e599690729487e2421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d42609-09d5-432e-9321-b9de78546aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d42609-09d5-432e-9321-b9de78546aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:51 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84df211d-f075-46ad-99f4-489c3f2347ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84df211d-f075-46ad-99f4-489c3f2347ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13261296-42f0-4e44-a37b-ce6491ffd0c5', 'volume_name': 'volume-13261296-42f0-4e44-a37b-ce6491ffd0c5', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcf3a40-8f56-4b94-bd68-6902d2e34200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcf3a40-8f56-4b94-bd68-6902d2e34200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834fed9d-f77e-41da-bf65-a864afa9ce8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:51 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Volume 13261296-42f0-4e44-a37b-ce6491ffd0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13261296-42f0-4e44-a37b-ce6491ffd0c5', 'volume_size': 1}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.338s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:51 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0317f608-2020-4652-9226-dd62bd1cd167 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f" returned: 0 in 1.261s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:51 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f is being set with open permissions: ugo+rw
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:51 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f
Apr 29 08:35:51 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:51 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f" returned: 0 in 0.722s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:52 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.info
Apr 29 08:35:52 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:52 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.info" returned: 0 in 0.757s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:52 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.info is being set with open permissions: ugo+rw
Apr 29 08:35:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:52 devstack sudo[87492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.info
Apr 29 08:35:52 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:53 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.info" returned: 0 in 0.832s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.252s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.485s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1787914233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13261296-42f0-4e44-a37b-ce6491ffd0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590eb9c0e04b462bae70f67185621c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:51Z,use_quota=True,user_id='5a7103df2f8447e599690729487e2421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Creating volume 13261296-42f0-4e44-a37b-ce6491ffd0c5 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:53 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:35:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:53 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5 1073741824
Apr 29 08:35:53 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:53 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-c3b37357-c560-430b-8e66-8dfa28226315 req-e3d25300-1104-493c-ba35-626a9825f937 tempest-VolumesSnapshotsTestJSON-642240631 None] Create snapshot completed successfully
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Acquiring lock "cinder-31e423b2-62a3-41fd-8c6f-29e97e080f8f-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-31e423b2-62a3-41fd-8c6f-29e97e080f8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Acquiring lock "cinder-quobyte-0317f608-2020-4652-9226-dd62bd1cd167" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-quobyte-0317f608-2020-4652-9226-dd62bd1cd167" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Acquiring lock "cinder-quobyte-31e423b2-62a3-41fd-8c6f-29e97e080f8f" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-quobyte-31e423b2-62a3-41fd-8c6f-29e97e080f8f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Deleting offline snapshot 31e423b2-62a3-41fd-8c6f-29e97e080f8f of volume 0317f608-2020-4652-9226-dd62bd1cd167 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] snapshot_file for this snap is: volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b12bdb-d3d2-483d-b02e-1916787b7398]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:54 devstack sudo[87565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f
Apr 29 08:35:54 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:55 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5 1073741824" returned: 0 in 1.462s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:55 devstack sudo[87569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5
Apr 29 08:35:55 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:55 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f" returned: 0 in 1.132s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0317f608-2020-4652-9226-dd62bd1cd167(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:55 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f30c117-5727-4777-bfcf-3aca8c3643be]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:56 devstack sudo[87575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167
Apr 29 08:35:56 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:56 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5" returned: 0 in 0.859s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:56 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] <== create_volume: return (2392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834fed9d-f77e-41da-bf65-a864afa9ce8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13261296-42f0-4e44-a37b-ce6491ffd0c5', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78048f14-48e0-44a8-9301-1d5bbb1ea4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:56 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Volume volume-13261296-42f0-4e44-a37b-ce6491ffd0c5 (13261296-42f0-4e44-a37b-ce6491ffd0c5): created successfully
Apr 29 08:35:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78048f14-48e0-44a8-9301-1d5bbb1ea4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Flow 'volume_create_manager' (3b1b5da0-78aa-407a-9bea-562f8342abec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6bb6d14c-8036-4f44-bcf6-a4dbc4b6954f tempest-ServersNegativeTestJSON-1309059733 None] Created volume successfully.
Apr 29 08:35:56 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167" returned: 0 in 0.953s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:56 devstack sudo[87581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f
Apr 29 08:35:56 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "cinder-13261296-42f0-4e44-a37b-ce6491ffd0c5-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Lock "cinder-13261296-42f0-4e44-a37b-ce6491ffd0c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "cinder-quobyte-13261296-42f0-4e44-a37b-ce6491ffd0c5" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Lock "cinder-quobyte-13261296-42f0-4e44-a37b-ce6491ffd0c5" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:57 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e82cee-548b-4d11-bf91-c499a7116208]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:57 devstack sudo[87583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5
Apr 29 08:35:57 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:57 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f" returned: 0 in 0.932s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:57 devstack sudo[87588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f
Apr 29 08:35:57 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:58 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5" returned: 0 in 0.946s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:58 devstack sudo[87596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5
Apr 29 08:35:58 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:58 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167.31e423b2-62a3-41fd-8c6f-29e97e080f8f" returned: 0 in 0.810s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-quobyte-31e423b2-62a3-41fd-8c6f-29e97e080f8f" released by "_delete_snapshot" :: held 3.992s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-quobyte-0317f608-2020-4652-9226-dd62bd1cd167" released by "delete_snapshot" :: held 4.029s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:58 devstack cinder-volume[83885]: DEBUG cinder.quota [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Created reservations ['b2f8573b-a854-43a5-ad0e-83e70949e05f', '3a8f420a-877f-4543-b70d-60e4b2874461', '7dc4aa48-2710-4f4f-88f1-8c7a0a16165a', '121656da-1de4-4d50-900c-f2e8cb295ec8'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:58 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Delete snapshot completed successfully.
Apr 29 08:35:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-9ac7dc5c-de9c-4411-b540-9d4483340d1d req-a7dd3c3b-f6ae-416e-b305-ef4b72a7134a tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-31e423b2-62a3-41fd-8c6f-29e97e080f8f-delete_snapshot" released by "delete_snapshot" :: held 4.283s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:58 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13261296-42f0-4e44-a37b-ce6491ffd0c5" returned: 0 in 0.790s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Lock "cinder-quobyte-13261296-42f0-4e44-a37b-ce6491ffd0c5" released by "delete_volume" :: held 1.800s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Acquiring lock "cinder-0317f608-2020-4652-9226-dd62bd1cd167-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Created reservations ['40b24a53-ee30-4dcd-8c6b-5f5756d1f6a9', '60c5e33d-2a4c-4236-98a7-26868b4defc6', '29968870-f556-43df-8cc7-6985cb53e399', 'a746339d-a646-422a-b0ec-1ccd9e1e0296'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-0317f608-2020-4652-9226-dd62bd1cd167-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Acquiring lock "cinder-quobyte-0317f608-2020-4652-9226-dd62bd1cd167" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-quobyte-0317f608-2020-4652-9226-dd62bd1cd167" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2ac59c-54d9-4dc9-b01d-009e981f6c8d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:59 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:35:59 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:59 devstack sudo[87600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167
Apr 29 08:35:59 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "cinder-dcea1d19-9490-4315-abcf-0cd1241da1ff-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Lock "cinder-dcea1d19-9490-4315-abcf-0cd1241da1ff-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "cinder-quobyte-dcea1d19-9490-4315-abcf-0cd1241da1ff" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Lock "cinder-quobyte-dcea1d19-9490-4315-abcf-0cd1241da1ff" acquired by "delete_volume" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca3d10-20a8-466c-bcc2-14a26190c907]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:59 devstack sudo[87604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff
Apr 29 08:35:59 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:00 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.886s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:00 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:00 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Deleted volume successfully.
Apr 29 08:36:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0a783c0e-a73d-4f99-bf26-974884090408 tempest-ServersNegativeTestJSON-1309059733 None] Lock "cinder-13261296-42f0-4e44-a37b-ce6491ffd0c5-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:00 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167" returned: 0 in 1.317s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:00 devstack sudo[87613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167
Apr 29 08:36:00 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:00 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff" returned: 0 in 1.054s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:00 devstack sudo[87616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff
Apr 29 08:36:00 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:01 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0317f608-2020-4652-9226-dd62bd1cd167" returned: 0 in 0.648s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-quobyte-0317f608-2020-4652-9226-dd62bd1cd167" released by "delete_volume" :: held 2.052s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.quota [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Created reservations ['c961bc9e-0b89-4438-b303-c94de4008b19', '09a6c183-b19d-45ba-9b97-72256f1810e3', 'b38723a8-d9b1-4f6a-af39-b02db9fd76e3', '81e7ca00-60c7-4a91-a5be-5dc6f1d3952e'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:01 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dcea1d19-9490-4315-abcf-0cd1241da1ff" returned: 0 in 0.654s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Lock "cinder-quobyte-dcea1d19-9490-4315-abcf-0cd1241da1ff" released by "delete_volume" :: held 1.771s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:01 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:01 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Created reservations ['f2acef59-2b38-4f90-b9ee-3dd8e7dc90fb', 'ddd11fb8-5b11-4668-90ed-62b1271a120d', 'f81c2ca2-90b9-42d0-a958-19648c1e0999', '9a37f003-bd59-4561-be5a-442fbaa98767'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:01 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:01 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Flow 'volume_create_manager' (20c2f4e9-522a-4ebf-8907-da341da575f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73224b30-139c-4517-93eb-25e29dde622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73224b30-139c-4517-93eb-25e29dde622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1403428552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd4fa8a-57ef-4dcf-857e-96338e29fc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6da806172048999b9fe8802bca0e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:02Z,use_quota=True,user_id='9ab270990f2243869e21361374ebce11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f00c957-ca59-4488-b503-c9f0e02ebb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f00c957-ca59-4488-b503-c9f0e02ebb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f47ddf-09d2-46c4-807b-0bc8d94cb06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f47ddf-09d2-46c4-807b-0bc8d94cb06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd4fa8a-57ef-4dcf-857e-96338e29fc44', 'volume_name': 'volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87992717-4cc4-4ff5-a79a-dc3e59826716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87992717-4cc4-4ff5-a79a-dc3e59826716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd8b4a4-64ce-4868-a886-630ab7edafda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:01 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Volume 2dd4fa8a-57ef-4dcf-857e-96338e29fc44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44', 'volume_size': 1}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1403428552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd4fa8a-57ef-4dcf-857e-96338e29fc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6da806172048999b9fe8802bca0e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:02Z,use_quota=True,user_id='9ab270990f2243869e21361374ebce11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Creating volume 2dd4fa8a-57ef-4dcf-857e-96338e29fc44 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:01 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:36:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:02 devstack sudo[87624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44 1073741824
Apr 29 08:36:02 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:02 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.928s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:02 devstack cinder-volume[83885]: DEBUG cinder.manager [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Deleted volume successfully.
Apr 29 08:36:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-ee63699f-7bfc-47af-a2d9-3c5c84092482 req-411e572a-2b5f-43d5-9414-0e86dae3d6d3 tempest-VolumesSnapshotsTestJSON-642240631 None] Lock "cinder-0317f608-2020-4652-9226-dd62bd1cd167-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:02 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.956s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:02 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Deleted volume successfully.
Apr 29 08:36:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95cb9b0a-3399-481c-8642-9884f668108c tempest-ServersNegativeTestJSON-1309059733 None] Lock "cinder-dcea1d19-9490-4315-abcf-0cd1241da1ff-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:03 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44 1073741824" returned: 0 in 1.129s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:03 devstack sudo[87644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44
Apr 29 08:36:03 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:04 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44" returned: 0 in 0.907s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd8b4a4-64ce-4868-a886-630ab7edafda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4ce77f-973f-42f2-97dc-519fab9ed2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:04 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Volume volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44 (2dd4fa8a-57ef-4dcf-857e-96338e29fc44): created successfully
Apr 29 08:36:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4ce77f-973f-42f2-97dc-519fab9ed2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Flow 'volume_create_manager' (20c2f4e9-522a-4ebf-8907-da341da575f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:04 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4635f88a-402a-4fce-aa4f-40e52a5af515 tempest-VolumesServicesTestJSON-1366810956 None] Created volume successfully.
Apr 29 08:36:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Acquiring lock "cinder-2dd4fa8a-57ef-4dcf-857e-96338e29fc44-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Lock "cinder-2dd4fa8a-57ef-4dcf-857e-96338e29fc44-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Acquiring lock "cinder-quobyte-2dd4fa8a-57ef-4dcf-857e-96338e29fc44" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Lock "cinder-quobyte-2dd4fa8a-57ef-4dcf-857e-96338e29fc44" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:05 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb164f57-3731-43b6-81e2-39b5e7ccae7c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:05 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44
Apr 29 08:36:05 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:06 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44" returned: 0 in 0.794s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:06 devstack sudo[87695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44
Apr 29 08:36:06 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:07 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2dd4fa8a-57ef-4dcf-857e-96338e29fc44" returned: 0 in 0.713s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Lock "cinder-quobyte-2dd4fa8a-57ef-4dcf-857e-96338e29fc44" released by "delete_volume" :: held 1.599s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Created reservations ['9e096521-744b-49b8-b2d3-df2e59a01d4a', '68ca177a-3850-4118-91d2-99b5b610870f', '826c67be-738a-4892-9dde-a5170ef0a9fc', '2cdd3552-5b94-4604-b179-5f1ed8781ed3'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:07 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:07 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:07 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.632s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:07 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Deleted volume successfully.
Apr 29 08:36:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4500d224-7330-4576-a7a2-6c4a42d9393f tempest-VolumesServicesTestJSON-1366810956 None] Lock "cinder-2dd4fa8a-57ef-4dcf-857e-96338e29fc44-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:17 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=57,cinder:UPDATE=82,cinder:INSERT=25,cinder:DELETE=4 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:36:17 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:36:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Flow 'volume_create_manager' (1fac527f-79e5-455b-be41-5803b1021a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f2c5f3-3ce2-4c1a-a7ff-32d8b2f3fc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-8811893b-2aa0-4fd7-a56d-32e4892b13ce tempest-GroupsTest-995193401 None] Group tempest-Group1-1034079939: creating
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f2c5f3-3ce2-4c1a-a7ff-32d8b2f3fc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1834003625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029574d2-eaaf-48c1-b27a-3f0fdf8eb250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b690fa8622244a8693847a49b8d090ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:18Z,use_quota=True,user_id='f243c4bca3ba499cb385ea570b855bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee62b6e-62af-426b-bd5e-a37a9fd47e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee62b6e-62af-426b-bd5e-a37a9fd47e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87475a44-5630-4762-bb5c-427b0215f55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87475a44-5630-4762-bb5c-427b0215f55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '029574d2-eaaf-48c1-b27a-3f0fdf8eb250', 'volume_name': 'volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150a373a-5238-4c00-9be1-a52d875449ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150a373a-5238-4c00-9be1-a52d875449ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b15d43-3713-444a-947b-4c0b9b47a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:18 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Volume 029574d2-eaaf-48c1-b27a-3f0fdf8eb250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250', 'volume_size': 1}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1834003625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029574d2-eaaf-48c1-b27a-3f0fdf8eb250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b690fa8622244a8693847a49b8d090ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:18Z,use_quota=True,user_id='f243c4bca3ba499cb385ea570b855bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Creating volume 029574d2-eaaf-48c1-b27a-3f0fdf8eb250 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:18 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:36:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:18 devstack sudo[87802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 1073741824
Apr 29 08:36:18 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-8811893b-2aa0-4fd7-a56d-32e4892b13ce tempest-GroupsTest-995193401 None] Group tempest-Group1-1034079939: created successfully
Apr 29 08:36:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-8811893b-2aa0-4fd7-a56d-32e4892b13ce tempest-GroupsTest-995193401 None] Create group completed successfully.
Apr 29 08:36:19 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 1073741824" returned: 0 in 0.903s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:19 devstack sudo[87809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250
Apr 29 08:36:19 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-23d6ce14-2e2a-4bee-a5be-a8169d3628e8 tempest-GroupsTest-995193401 None] Group tempest-Group2-595914011: creating
Apr 29 08:36:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-23d6ce14-2e2a-4bee-a5be-a8169d3628e8 tempest-GroupsTest-995193401 None] Group tempest-Group2-595914011: created successfully
Apr 29 08:36:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-23d6ce14-2e2a-4bee-a5be-a8169d3628e8 tempest-GroupsTest-995193401 None] Create group completed successfully.
Apr 29 08:36:19 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" returned: 0 in 0.940s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b15d43-3713-444a-947b-4c0b9b47a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465d2f20-2d31-4a86-b463-3df6320f79f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:20 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Volume volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 (029574d2-eaaf-48c1-b27a-3f0fdf8eb250): created successfully
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465d2f20-2d31-4a86-b463-3df6320f79f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Flow 'volume_create_manager' (1fac527f-79e5-455b-be41-5803b1021a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:20 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3fd447d3-fcd4-4535-ae32-3c72ec09f02d tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Created volume successfully.
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Flow 'volume_create_manager' (360f7075-bbec-4b91-97a4-b8967a069543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fe8402-7157-43e2-bb83-f9aa9efb6d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fe8402-7157-43e2-bb83-f9aa9efb6d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1538591732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1d5289-1b88-4496-8050-24b2d9aa0442,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b09167c160446bebe588f4625b96b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:20Z,use_quota=True,user_id='62fc646da8e64488918feeb67d578145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf536b7-0291-4dee-95bc-e5a04cd38c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf536b7-0291-4dee-95bc-e5a04cd38c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2f3fab-f3bf-40ce-9274-827398367451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2f3fab-f3bf-40ce-9274-827398367451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1d5289-1b88-4496-8050-24b2d9aa0442', 'volume_name': 'volume-4f1d5289-1b88-4496-8050-24b2d9aa0442', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3350b41f-2f37-4c72-8fac-d2dffc849f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3350b41f-2f37-4c72-8fac-d2dffc849f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ae49f3-896b-4485-95d7-21ba4dd57593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:20 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Volume 4f1d5289-1b88-4496-8050-24b2d9aa0442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1d5289-1b88-4496-8050-24b2d9aa0442', 'volume_size': 1}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1538591732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1d5289-1b88-4496-8050-24b2d9aa0442,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b09167c160446bebe588f4625b96b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:20Z,use_quota=True,user_id='62fc646da8e64488918feeb67d578145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Creating volume 4f1d5289-1b88-4496-8050-24b2d9aa0442 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:20 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:36:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:20 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442 1073741824
Apr 29 08:36:20 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Flow 'volume_create_manager' (cdc88ce3-e4b5-429d-95ab-7ed9d0bc9110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d5724e-9b2f-4b0a-b874-294718bfb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d5724e-9b2f-4b0a-b874-294718bfb03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089487940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4d3c52f1-d1b0-40a2-879c-9d9edad325f1,host='devstack@QuobyteHD#QuobyteHD',id=eac86d6c-87f3-4592-86f5-81bff1cb0d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad137c8cf92141b8b62dd08253308114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:21Z,use_quota=True,user_id='62af7e731c7b46188ed4e441070063dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fe1cc0f-c6a2-4f33-910e-d9f4e688b626),volume_type_id=2fe1cc0f-c6a2-4f33-910e-d9f4e688b626)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ddacc8-a761-4bb7-a14c-7c5ff8baf4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ddacc8-a761-4bb7-a14c-7c5ff8baf4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a996f7-34fd-4047-bc37-010bd0915b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a996f7-34fd-4047-bc37-010bd0915b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac86d6c-87f3-4592-86f5-81bff1cb0d2e', 'volume_name': 'volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26826f45-fa58-41a7-89f0-df7ea23ae901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26826f45-fa58-41a7-89f0-df7ea23ae901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07c3f63-f20e-4077-bd9b-2d5613302649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:21 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Volume eac86d6c-87f3-4592-86f5-81bff1cb0d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e', 'volume_size': 1}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:21 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442 1073741824" returned: 0 in 1.150s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:21 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442
Apr 29 08:36:21 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:22 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442" returned: 0 in 0.644s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4d3c52f1-d1b0-40a2-879c-9d9edad325f1,created_at=2026-04-29T06:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089487940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4d3c52f1-d1b0-40a2-879c-9d9edad325f1,host='devstack@QuobyteHD#QuobyteHD',id=eac86d6c-87f3-4592-86f5-81bff1cb0d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad137c8cf92141b8b62dd08253308114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:21Z,use_quota=True,user_id='62af7e731c7b46188ed4e441070063dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fe1cc0f-c6a2-4f33-910e-d9f4e688b626),volume_type_id=2fe1cc0f-c6a2-4f33-910e-d9f4e688b626)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Creating volume eac86d6c-87f3-4592-86f5-81bff1cb0d2e {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:22 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ae49f3-896b-4485-95d7-21ba4dd57593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1d5289-1b88-4496-8050-24b2d9aa0442', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:22 devstack sudo[87845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e 1073741824
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e20b8a-942d-4b9a-8116-747d137979c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:22 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:22 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Volume volume-4f1d5289-1b88-4496-8050-24b2d9aa0442 (4f1d5289-1b88-4496-8050-24b2d9aa0442): created successfully
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e20b8a-942d-4b9a-8116-747d137979c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Flow 'volume_create_manager' (360f7075-bbec-4b91-97a4-b8967a069543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=82,cinder:INSERT=18,cinder:UPDATE=82,cinder:DELETE=7 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:36:22 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-0c0cc6e1-fbb4-47f0-b92a-38a400d13450 req-a9af2486-9ce3-4247-bbe6-5e8824fa91fe tempest-VolumesGetTestJSON-2003217565 None] Created volume successfully.
Apr 29 08:36:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Acquiring lock "cinder-4f1d5289-1b88-4496-8050-24b2d9aa0442-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:23 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Lock "cinder-4f1d5289-1b88-4496-8050-24b2d9aa0442-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:23 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Acquiring lock "cinder-quobyte-4f1d5289-1b88-4496-8050-24b2d9aa0442" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:23 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Lock "cinder-quobyte-4f1d5289-1b88-4496-8050-24b2d9aa0442" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:23 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef1a5b2-3eaa-4d44-812e-e85b2b0dcf3c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:23 devstack sudo[87852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442
Apr 29 08:36:23 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:23 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e 1073741824" returned: 0 in 1.219s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:23 devstack sudo[87854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e
Apr 29 08:36:23 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:24 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442" returned: 0 in 0.964s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:24 devstack sudo[87859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442
Apr 29 08:36:24 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:24 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e" returned: 0 in 0.662s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.871s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07c3f63-f20e-4077-bd9b-2d5613302649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd754e6-1945-46bc-b87c-4856fb3e81a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Creating offline snapshot 48e8386b-1eae-4068-8f65-565646870bd3 of volume 029574d2-eaaf-48c1-b27a-3f0fdf8eb250 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:36:24 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Volume volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e (eac86d6c-87f3-4592-86f5-81bff1cb0d2e): created successfully
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd754e6-1945-46bc-b87c-4856fb3e81a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Flow 'volume_create_manager' (cdc88ce3-e4b5-429d-95ab-7ed9d0bc9110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb26af2-8037-4392-ad70-4166ee52f8ac]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:24 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-cd58e68b-a497-458b-9dc1-5cb24055a5f1 tempest-GroupsTest-995193401 None] Created volume successfully.
Apr 29 08:36:24 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250
Apr 29 08:36:24 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:24 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4f1d5289-1b88-4496-8050-24b2d9aa0442" returned: 0 in 0.761s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Lock "cinder-quobyte-4f1d5289-1b88-4496-8050-24b2d9aa0442" released by "delete_volume" :: held 1.787s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:24 devstack cinder-volume[83885]: DEBUG cinder.quota [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Created reservations ['02240369-9983-41b4-9856-345cf0aab578', 'c9554b62-90b0-413a-944a-23dc522449e4', '07853597-e669-47e8-b4f0-49ee8d27424e', '700c4dd6-f5f8-44f6-a7cd-920492df6f47'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:25 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:25 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:25 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" returned: 0 in 0.795s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:25 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 1G
Apr 29 08:36:25 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:25 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.880s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG cinder.manager [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:25 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Deleted volume successfully.
Apr 29 08:36:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-c0594144-ea86-4cc5-8c11-eb8a32258f84 req-957665de-b781-4e6f-a0c5-65b7ce92365d tempest-VolumesGetTestJSON-2003217565 None] Lock "cinder-4f1d5289-1b88-4496-8050-24b2d9aa0442-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:26 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 1G" returned: 0 in 1.155s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Acquiring lock "cinder-quobyte-eac86d6c-87f3-4592-86f5-81bff1cb0d2e" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Lock "cinder-quobyte-eac86d6c-87f3-4592-86f5-81bff1cb0d2e" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:26 devstack sudo[87898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3
Apr 29 08:36:26 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:26 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[558eda68-cbe8-4b98-b390-ac2506b90b76]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:26 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e
Apr 29 08:36:26 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:27 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3" returned: 0 in 0.772s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:27 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 is being set with open permissions: ugo+rw
Apr 29 08:36:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:27 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3
Apr 29 08:36:27 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:27 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e" returned: 0 in 0.835s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:27 devstack sudo[87912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e
Apr 29 08:36:27 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:27 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3" returned: 0 in 0.720s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:27 devstack sudo[87916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.info
Apr 29 08:36:27 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:27 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eac86d6c-87f3-4592-86f5-81bff1cb0d2e" returned: 0 in 0.689s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Lock "cinder-quobyte-eac86d6c-87f3-4592-86f5-81bff1cb0d2e" released by "delete_volume" :: held 1.584s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Created reservations ['5d826327-0bb1-443a-a5f7-0e1b6ba64b34'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:28 devstack cinder-volume[83885]: WARNING cinder.quota [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-385008325 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-385008325, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:28 devstack cinder-volume[83885]: WARNING cinder.quota [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-385008325 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-385008325, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Created reservations ['efa90297-ce9b-4149-b902-f33337cd7d80', '61996087-db28-4258-a16f-d9a6432f2ccf', '24316495-f61c-4f81-99ba-39768672b4f4', '11e20be9-2e08-4a11-91ff-6d9df4f21f61'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:28 devstack sudo[87918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:28 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:28 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.info" returned: 0 in 0.638s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:28 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.info is being set with open permissions: ugo+rw
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:28 devstack sudo[87921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.info
Apr 29 08:36:28 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:28 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.703s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:28 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:28 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-aa2c30c6-1fea-4179-9293-50f3257c7202 tempest-GroupsTest-995193401 None] Delete group completed successfully.
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] Created reservations ['b31460c2-8db2-4cc7-b1dd-287ed1857321'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:29 devstack sudo[87924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:29 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:29 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.info" returned: 0 in 0.693s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.926s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-319a7f18-c50d-426e-adbe-fb2fc75d28d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Create snapshot completed successfully
Apr 29 08:36:29 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.659s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:29 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-daf9fc40-5636-412f-8179-a76ed8cf2516 tempest-GroupsTest-995193401 None] Delete group completed successfully.
Apr 29 08:36:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2baf9d3b-498f-44ab-9032-25d7a85b1594 tempest-GroupSnapshotsTest-2121115982 None] Group tempest-GroupSnapshotsTest-Group-570309723: creating
Apr 29 08:36:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2baf9d3b-498f-44ab-9032-25d7a85b1594 tempest-GroupSnapshotsTest-2121115982 None] Group tempest-GroupSnapshotsTest-Group-570309723: created successfully
Apr 29 08:36:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2baf9d3b-498f-44ab-9032-25d7a85b1594 tempest-GroupSnapshotsTest-2121115982 None] Create group completed successfully.
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Acquiring lock "cinder-48e8386b-1eae-4068-8f65-565646870bd3-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-48e8386b-1eae-4068-8f65-565646870bd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Acquiring lock "cinder-quobyte-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-quobyte-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Acquiring lock "cinder-quobyte-48e8386b-1eae-4068-8f65-565646870bd3" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-quobyte-48e8386b-1eae-4068-8f65-565646870bd3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Deleting offline snapshot 48e8386b-1eae-4068-8f65-565646870bd3 of volume 029574d2-eaaf-48c1-b27a-3f0fdf8eb250 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] snapshot_file for this snap is: volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[07448d52-f09d-4581-a642-b495b31a06aa]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:30 devstack sudo[87928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3
Apr 29 08:36:30 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:30 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-fc70ac17-7f4b-4599-941f-b0b77af4aecb tempest-GroupsTest-995193401 None] Group tempest-GroupsTest-Group-343206647: creating
Apr 29 08:36:30 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-fc70ac17-7f4b-4599-941f-b0b77af4aecb tempest-GroupsTest-995193401 None] Group tempest-GroupsTest-Group-343206647: created successfully
Apr 29 08:36:30 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-fc70ac17-7f4b-4599-941f-b0b77af4aecb tempest-GroupsTest-995193401 None] Create group completed successfully.
Apr 29 08:36:31 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3" returned: 0 in 0.791s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a54c43-1fd7-4dad-8d1f-80628dda126e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:31 devstack sudo[87939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250
Apr 29 08:36:31 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Flow 'volume_create_manager' (fd2e0dce-75fb-4a40-9769-c57b752f05d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a112165-6325-4056-987a-260ba88e0b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a112165-6325-4056-987a-260ba88e0b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-252151194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cf96d40c-1005-4301-9722-5f0b1bbc8e81,host='devstack@QuobyteHD#QuobyteHD',id=787c3933-808b-41ce-8b3d-81a5211e34f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae85ab8d4e84b1683510348905a3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:31Z,use_quota=True,user_id='3c22988ce12645fc8c98445b58e08956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0913a154-ce43-4065-bb53-9163a9968bb6),volume_type_id=0913a154-ce43-4065-bb53-9163a9968bb6)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcfe8eb-782e-42b6-9989-7bdec7fbf2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcfe8eb-782e-42b6-9989-7bdec7fbf2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c2041-a1d5-4bbf-9134-d917f87205ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c2041-a1d5-4bbf-9134-d917f87205ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787c3933-808b-41ce-8b3d-81a5211e34f9', 'volume_name': 'volume-787c3933-808b-41ce-8b3d-81a5211e34f9', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4be7513-8e00-4d09-9f50-b2771f2d386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4be7513-8e00-4d09-9f50-b2771f2d386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315111bf-a1c7-47df-be3f-3bee06fb5384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:31 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Volume 787c3933-808b-41ce-8b3d-81a5211e34f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787c3933-808b-41ce-8b3d-81a5211e34f9', 'volume_size': 1}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cf96d40c-1005-4301-9722-5f0b1bbc8e81,created_at=2026-04-29T06:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-252151194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cf96d40c-1005-4301-9722-5f0b1bbc8e81,host='devstack@QuobyteHD#QuobyteHD',id=787c3933-808b-41ce-8b3d-81a5211e34f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae85ab8d4e84b1683510348905a3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:31Z,use_quota=True,user_id='3c22988ce12645fc8c98445b58e08956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0913a154-ce43-4065-bb53-9163a9968bb6),volume_type_id=0913a154-ce43-4065-bb53-9163a9968bb6)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Creating volume 787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:31 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:36:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:31 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 1073741824
Apr 29 08:36:31 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:32 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:36:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Flow 'volume_create_manager' (b85482c1-67c8-4fde-830b-13b5ac27022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c42860-b7aa-46e2-948e-0b48d563bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c42860-b7aa-46e2-948e-0b48d563bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392973453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5cda32de-41e1-45df-bd84-1b5bb02fc4a4,host='devstack@QuobyteHD#QuobyteHD',id=e6892d93-0ff4-4318-8979-e4990f40d9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad137c8cf92141b8b62dd08253308114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:33Z,use_quota=True,user_id='62af7e731c7b46188ed4e441070063dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a62eba00-0bd9-4c73-8730-8fc242b3da94),volume_type_id=a62eba00-0bd9-4c73-8730-8fc242b3da94)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f84bf08-889a-4ef9-bdeb-0fdd98012edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:32 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f84bf08-889a-4ef9-bdeb-0fdd98012edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92dc272c-8809-4a84-90c5-1a1bd92f6dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92dc272c-8809-4a84-90c5-1a1bd92f6dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6892d93-0ff4-4318-8979-e4990f40d9f4', 'volume_name': 'volume-e6892d93-0ff4-4318-8979-e4990f40d9f4', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af5331a-be8c-4bdb-89f7-b025469f6ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af5331a-be8c-4bdb-89f7-b025469f6ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85225ca5-2831-4a7e-bb31-70d1dda42545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:33 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Volume e6892d93-0ff4-4318-8979-e4990f40d9f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6892d93-0ff4-4318-8979-e4990f40d9f4', 'volume_size': 1}
Apr 29 08:36:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" returned: 0 in 1.801s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:33 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3
Apr 29 08:36:33 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:33 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 1073741824" returned: 0 in 1.353s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:33 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9
Apr 29 08:36:33 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:34 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9" returned: 0 in 0.835s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] <== create_volume: return (2258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5cda32de-41e1-45df-bd84-1b5bb02fc4a4,created_at=2026-04-29T06:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392973453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5cda32de-41e1-45df-bd84-1b5bb02fc4a4,host='devstack@QuobyteHD#QuobyteHD',id=e6892d93-0ff4-4318-8979-e4990f40d9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad137c8cf92141b8b62dd08253308114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:33Z,use_quota=True,user_id='62af7e731c7b46188ed4e441070063dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a62eba00-0bd9-4c73-8730-8fc242b3da94),volume_type_id=a62eba00-0bd9-4c73-8730-8fc242b3da94)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Creating volume e6892d93-0ff4-4318-8979-e4990f40d9f4 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:34 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:34 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3" returned: 0 in 1.044s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:34 devstack sudo[87960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4 1073741824
Apr 29 08:36:34 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315111bf-a1c7-47df-be3f-3bee06fb5384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787c3933-808b-41ce-8b3d-81a5211e34f9', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:34 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3
Apr 29 08:36:34 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4908b1cc-f6b4-4a45-b492-1f81e06cd842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:34 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Volume volume-787c3933-808b-41ce-8b3d-81a5211e34f9 (787c3933-808b-41ce-8b3d-81a5211e34f9): created successfully
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4908b1cc-f6b4-4a45-b492-1f81e06cd842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Flow 'volume_create_manager' (fd2e0dce-75fb-4a40-9769-c57b752f05d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:34 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-8492f992-136e-4ae0-8aa0-488934efca12 tempest-GroupSnapshotsTest-2121115982 None] Created volume successfully.
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Flow 'volume_create_manager' (80a9676d-049a-4009-be90-ba3ba3ce084a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73ff931-773a-4aa7-9369-b4f94018147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73ff931-773a-4aa7-9369-b4f94018147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:34Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd53f8f-0af6-4ecb-a64c-6122ad823f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18194838e1fc4ddfb4610c9e0b7e93ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:34Z,use_quota=True,user_id='003f72a5d5ec4d1cb35ac2e056df927d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ae83a2-f553-48db-b743-cfd35d2aaee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ae83a2-f553-48db-b743-cfd35d2aaee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba11fc81-5eba-48b9-8cf8-1f3960ca02e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.image.glance [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Creating Keystone auth plugin from conf {{(pid=83885) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba11fc81-5eba-48b9-8cf8-1f3960ca02e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'abd53f8f-0af6-4ecb-a64c-6122ad823f1b', 'volume_name': 'volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e517c50>}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b5f847-9c5f-49d1-ad8a-4efa3e2d1543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b5f847-9c5f-49d1-ad8a-4efa3e2d1543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789f6a94-a55a-4b52-b61d-e93ce065a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:34 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Volume abd53f8f-0af6-4ecb-a64c-6122ad823f1b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e517c50>}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Trying to clone abd53f8f-0af6-4ecb-a64c-6122ad823f1b from image b7d8ee2a-d63e-4da9-983e-f810d728a919 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]). {{(pid=83885) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Apr 29 08:36:34 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250.48e8386b-1eae-4068-8f65-565646870bd3" returned: 0 in 0.733s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-quobyte-48e8386b-1eae-4068-8f65-565646870bd3" released by "_delete_snapshot" :: held 4.555s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-quobyte-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" released by "delete_snapshot" :: held 4.594s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Created reservations ['d047c42f-8a88-4053-a479-67939292895c', '40914fee-08ac-4e26-b023-bfd69eca1a4a', '20600873-eb81-425b-85d9-6c67f57de010', '1034ecab-8380-4dce-9041-a98fc8d3fd2b'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:35 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4 1073741824" returned: 0 in 1.090s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 08:36:35 devstack cinder-volume[83885]: INFO cinder.image.image_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 08:36:35 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Delete snapshot completed successfully.
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc0a1fa7-d95a-4e4d-a715-54cb30703f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-48e8386b-1eae-4068-8f65-565646870bd3-delete_snapshot" released by "delete_snapshot" :: held 4.930s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[560126c7-68dd-4845-a451-2bfad7a4b854]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:35 devstack sudo[87990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4
Apr 29 08:36:35 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:35 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] GroupSnapshot 4466dd5e-bd9d-4248-aca2-edc48f387c06: creating.
Apr 29 08:36:35 devstack sudo[87991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD
Apr 29 08:36:35 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Group snapshot 4466dd5e-bd9d-4248-aca2-edc48f387c06: creating. {{(pid=83885) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Acquiring lock "cinder-029574d2-eaaf-48c1-b27a-3f0fdf8eb250-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-029574d2-eaaf-48c1-b27a-3f0fdf8eb250-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Acquiring lock "cinder-quobyte-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-quobyte-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:36 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:36 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4" returned: 0 in 0.834s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Temporary image b7d8ee2a-d63e-4da9-983e-f810d728a919 is fetched for user 003f72a5d5ec4d1cb35ac2e056df927d. {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.654s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd7eac-d3fd-40c9-a779-96ec6ca078fb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85225ca5-2831-4a7e-bb31-70d1dda42545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6892d93-0ff4-4318-8979-e4990f40d9f4', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62abd7c-df99-4221-8c16-a091337fd8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Creating offline snapshot efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 of volume 787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:36:36 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Volume volume-e6892d93-0ff4-4318-8979-e4990f40d9f4 (e6892d93-0ff4-4318-8979-e4990f40d9f4): created successfully
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62abd7c-df99-4221-8c16-a091337fd8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Flow 'volume_create_manager' (b85482c1-67c8-4fde-830b-13b5ac27022a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd41f43-c5ea-4555-9150-1600f81a0b95]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:36 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-10b2d4e5-532f-42d4-88e3-260930832b0d tempest-GroupsTest-995193401 None] Created volume successfully.
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fd982f-eb91-4330-9e01-c8980f3ec56d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:36 devstack sudo[87999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250
Apr 29 08:36:36 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:36 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9
Apr 29 08:36:36 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:36 devstack sudo[88002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD
Apr 29 08:36:36 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Flow 'volume_create_manager' (d2ea9b7d-994a-4be7-b718-19f3492b9563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2efe9ad-232c-4688-baea-5d1b1347a8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2efe9ad-232c-4688-baea-5d1b1347a8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38088847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5cda32de-41e1-45df-bd84-1b5bb02fc4a4,host='devstack@QuobyteHD#QuobyteHD',id=b515297f-7cb0-4260-b09f-0f3e8b13268e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad137c8cf92141b8b62dd08253308114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:37Z,use_quota=True,user_id='62af7e731c7b46188ed4e441070063dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a62eba00-0bd9-4c73-8730-8fc242b3da94),volume_type_id=a62eba00-0bd9-4c73-8730-8fc242b3da94)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801640ba-0f56-4763-98a8-63efa3b8834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801640ba-0f56-4763-98a8-63efa3b8834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d109bb18-6747-49ae-b52c-5d5aa413f3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d109bb18-6747-49ae-b52c-5d5aa413f3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b515297f-7cb0-4260-b09f-0f3e8b13268e', 'volume_name': 'volume-b515297f-7cb0-4260-b09f-0f3e8b13268e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d1efd1-63ee-4516-b51c-f30836919a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:37 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d1efd1-63ee-4516-b51c-f30836919a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd3cca4-1346-4b24-8689-345b187a5c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:37 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Volume b515297f-7cb0-4260-b09f-0f3e8b13268e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b515297f-7cb0-4260-b09f-0f3e8b13268e', 'volume_size': 1}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" returned: 0 in 1.099s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:37 devstack sudo[88015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250
Apr 29 08:36:37 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:37 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD" returned: 0 in 1.039s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:37 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9" returned: 0 in 1.156s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:37 devstack sudo[88017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 1G
Apr 29 08:36:37 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:37 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" returned: 0 in 0.659s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-quobyte-029574d2-eaaf-48c1-b27a-3f0fdf8eb250" released by "delete_volume" :: held 1.847s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:37 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Created reservations ['bcf28f6d-452a-42a5-8d13-dcaabbafce23', '706eb455-e030-4eb4-919d-4d3d05b99fe8', '671429c1-0373-4e74-b167-5bc7e5b4c9cd', 'a4fccd10-a68e-434e-af80-556aeea911d4'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:38 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:38 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:38 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 1G" returned: 0 in 0.961s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787c3933-808b-41ce-8b3d-81a5211e34f9 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:38 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787c3933-808b-41ce-8b3d-81a5211e34f9 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1
Apr 29 08:36:38 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:38 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.631s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:38 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Deleted volume successfully.
Apr 29 08:36:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9b6fed52-d317-4e0b-81f7-185f1c2ab5ad tempest-VolumeSnapshotQuotasNegativeTestJSON-2050778818 None] Lock "cinder-029574d2-eaaf-48c1-b27a-3f0fdf8eb250-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:39 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787c3933-808b-41ce-8b3d-81a5211e34f9 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1" returned: 0 in 0.727s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:39 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:36:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:39 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1
Apr 29 08:36:39 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:39 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1" returned: 0 in 0.629s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:39 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.info
Apr 29 08:36:39 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:40 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.info" returned: 0 in 0.590s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:40 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:40 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.info
Apr 29 08:36:40 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:40 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.info" returned: 0 in 0.630s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.838s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.728s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5cda32de-41e1-45df-bd84-1b5bb02fc4a4,created_at=2026-04-29T06:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38088847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5cda32de-41e1-45df-bd84-1b5bb02fc4a4,host='devstack@QuobyteHD#QuobyteHD',id=b515297f-7cb0-4260-b09f-0f3e8b13268e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad137c8cf92141b8b62dd08253308114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:37Z,use_quota=True,user_id='62af7e731c7b46188ed4e441070063dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a62eba00-0bd9-4c73-8730-8fc242b3da94),volume_type_id=a62eba00-0bd9-4c73-8730-8fc242b3da94)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Creating volume b515297f-7cb0-4260-b09f-0f3e8b13268e {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:40 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:36:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:40 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e 1073741824
Apr 29 08:36:40 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:41 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-30d3446e-a7db-4cf5-ac9e-a91a02cc48b2 tempest-GroupSnapshotsTest-2121115982 None] group_snapshot 4466dd5e-bd9d-4248-aca2-edc48f387c06: created successfully
Apr 29 08:36:41 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e 1073741824" returned: 0 in 0.892s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:41 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e
Apr 29 08:36:41 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:42 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e" returned: 0 in 0.704s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.307s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:34Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd53f8f-0af6-4ecb-a64c-6122ad823f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18194838e1fc4ddfb4610c9e0b7e93ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:34Z,use_quota=True,user_id='003f72a5d5ec4d1cb35ac2e056df927d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Creating volume abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:42 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd3cca4-1346-4b24-8689-345b187a5c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b515297f-7cb0-4260-b09f-0f3e8b13268e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:42 devstack sudo[88052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b 1073741824
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e31c0a-9d6b-4d13-b101-9ddbd3cd4bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:42 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:42 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Volume volume-b515297f-7cb0-4260-b09f-0f3e8b13268e (b515297f-7cb0-4260-b09f-0f3e8b13268e): created successfully
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e31c0a-9d6b-4d13-b101-9ddbd3cd4bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Flow 'volume_create_manager' (d2ea9b7d-994a-4be7-b718-19f3492b9563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-dd6087b5-5812-4790-be28-ec127f942bab tempest-GroupsTest-995193401 None] Created volume successfully.
Apr 29 08:36:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:43 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b 1073741824" returned: 0 in 1.014s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:43 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b
Apr 29 08:36:43 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:43 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3e3bb66a-2b2e-460c-b732-9f00d55ac24e tempest-GroupsTest-995193401 None] Update group completed successfully.
Apr 29 08:36:44 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" returned: 0 in 0.643s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.262s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1-c87e2317-42ae-402f-b9cd-100de593932d" by "_create_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1-c87e2317-42ae-402f-b9cd-100de593932d" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Creating volume c87e2317-42ae-402f-b9cd-100de593932d from snapshot efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 {{(pid=83885) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-c87e2317-42ae-402f-b9cd-100de593932d" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Attempting download of b7d8ee2a-d63e-4da9-983e-f810d728a919 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}])) to volume abd53f8f-0af6-4ecb-a64c-6122ad823f1b. {{(pid=83885) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-c87e2317-42ae-402f-b9cd-100de593932d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] snapshot: efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1, volume: c87e2317-42ae-402f-b9cd-100de593932d,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[658f37f2-d114-403a-9c7f-0a8197a70127]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dcb0c5-1e24-4bd9-84a5-b518f9bfaad0]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_yif_vr3o {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:44 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1
Apr 29 08:36:44 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:44 devstack sudo[88063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_yif_vr3o
Apr 29 08:36:44 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:45 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-15bb5b2f-9534-4f4c-984a-f460a44e40dd tempest-GroupsTest-995193401 None] Update group completed successfully.
Apr 29 08:36:45 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_yif_vr3o" returned: 0 in 0.788s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_yif_vr3o {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:45 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1" returned: 0 in 0.895s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787c3933-808b-41ce-8b3d-81a5211e34f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:36:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:36:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:36:45 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_yif_vr3o
Apr 29 08:36:45 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:45 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7157e581-d0c3-4716-b1ba-4ef8ac81ccaa]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:45 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9
Apr 29 08:36:45 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:46 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_yif_vr3o" returned: 1 in 0.789s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_yif_vr3o' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab583ee4-ef90-45f1-959a-6608534bc271]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:46 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD
Apr 29 08:36:46 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:46 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9" returned: 0 in 0.794s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:46 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d
Apr 29 08:36:46 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Acquiring lock "cinder-quobyte-b515297f-7cb0-4260-b09f-0f3e8b13268e" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:46 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] b7d8ee2a-d63e-4da9-983e-f810d728a919 was qcow2, converting to raw {{(pid=83885) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Lock "cinder-quobyte-b515297f-7cb0-4260-b09f-0f3e8b13268e" acquired by "delete_volume" :: waited 0.036s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:46 devstack sudo[88091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b
Apr 29 08:36:46 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2732336a-31b0-41cd-a1e8-b0f38b69423f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:46 devstack sudo[88093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e
Apr 29 08:36:46 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:48 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e" returned: 0 in 1.818s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:48 devstack sudo[88114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e
Apr 29 08:36:48 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:36:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:49 devstack sudo[88116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:49 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:50 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b515297f-7cb0-4260-b09f-0f3e8b13268e" returned: 0 in 1.584s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Lock "cinder-quobyte-b515297f-7cb0-4260-b09f-0f3e8b13268e" released by "delete_volume" :: held 3.482s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Acquiring lock "cinder-quobyte-e6892d93-0ff4-4318-8979-e4990f40d9f4" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Lock "cinder-quobyte-e6892d93-0ff4-4318-8979-e4990f40d9f4" acquired by "delete_volume" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:50 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[89db6377-4b0b-4226-a560-316c0fcaba61]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:50 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4
Apr 29 08:36:50 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:51 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.388s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:51 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:51 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" returned: 0 in 4.945s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:51 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_pwvbazfadevstack@QuobyteHD, size 112.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:36:51 devstack cinder-volume[83885]: INFO cinder.image.image_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Converted 112.00 MB image at 22.62 MB/s
Apr 29 08:36:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:51 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b 1G
Apr 29 08:36:51 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:52 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4" returned: 0 in 2.054s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:52 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4
Apr 29 08:36:52 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:52 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d" returned: 0 in 6.611s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:52 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64dd27b-22ad-46ef-9b95-e2601d632a98]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:52 devstack sudo[88130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9
Apr 29 08:36:52 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:53 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b 1G" returned: 0 in 1.360s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f6b83e-dca9-499b-96c2-bcccacb4b421]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:53 devstack sudo[88136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b
Apr 29 08:36:53 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:53 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6892d93-0ff4-4318-8979-e4990f40d9f4" returned: 0 in 0.868s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Lock "cinder-quobyte-e6892d93-0ff4-4318-8979-e4990f40d9f4" released by "delete_volume" :: held 3.075s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Created reservations ['821e3668-c7fd-42f5-9253-6c95a311cc07'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:53 devstack cinder-volume[83885]: WARNING cinder.quota [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-175184346 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-175184346, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:53 devstack cinder-volume[83885]: WARNING cinder.quota [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-175184346 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-175184346, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Created reservations ['5a50ca49-f77f-44a8-8017-6d3d8d62ebe6', 'd4bb92fd-b46f-4482-ac30-eda5b09125bf', 'd1ad6351-01b4-4635-934d-d1e373e13d7d', '93edf11b-a0d3-4f49-89a7-2a4d2ed93591'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Created reservations ['561bccce-1c35-4f35-aa09-74d908e7fc98', 'f4a92ca1-7fdb-423f-acb6-0d20695c3d9a', 'fbebeeed-c3f3-43da-a48b-f387f68bc450', '15617bdc-6e2f-4077-b048-64bb7450f3f1'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:53 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9" returned: 0 in 1.007s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:36:53 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Converted 1024.00 MB image at 154.87 MB/s
Apr 29 08:36:53 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:53 devstack sudo[88143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:53 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:53 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:53 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:54 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" returned: 0 in 0.926s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:54 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b
Apr 29 08:36:54 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:54 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.034s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:54 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:54 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d71c5a9a-3b9b-4762-aab7-2d1f49987ab7 tempest-GroupsTest-995193401 None] Delete group completed successfully.
Apr 29 08:36:54 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d" returned: 0 in 1.115s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-c87e2317-42ae-402f-b9cd-100de593932d" released by "_copy_volume_from_snapshot" :: held 10.580s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1-c87e2317-42ae-402f-b9cd-100de593932d" released by "_create_volume_from_snapshot" :: held 10.635s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.667s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:55 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:55 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-74900753-feaa-4ea3-a8da-13d2400834e9 tempest-GroupSnapshotsTest-2121115982 None] Create group from source-snapshot-4466dd5e-bd9d-4248-aca2-edc48f387c06 completed successfully.
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" returned: 1 in 1.016s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Downloaded image b7d8ee2a-d63e-4da9-983e-f810d728a919 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}])) to volume abd53f8f-0af6-4ecb-a64c-6122ad823f1b successfully. {{(pid=83885) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Temporary image b7d8ee2a-d63e-4da9-983e-f810d728a919 for user 003f72a5d5ec4d1cb35ac2e056df927d is deleted. {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Marking volume abd53f8f-0af6-4ecb-a64c-6122ad823f1b as bootable. {{(pid=83885) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Copying metadata from image b7d8ee2a-d63e-4da9-983e-f810d728a919 to abd53f8f-0af6-4ecb-a64c-6122ad823f1b. {{(pid=83885) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Creating volume glance metadata for volume abd53f8f-0af6-4ecb-a64c-6122ad823f1b backed by image b7d8ee2a-d63e-4da9-983e-f810d728a919 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83885) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789f6a94-a55a-4b52-b61d-e93ce065a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e517c50>}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb547dd1-8dd8-4c85-807d-d33c033c6a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:55 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Volume volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b (abd53f8f-0af6-4ecb-a64c-6122ad823f1b): created successfully
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb547dd1-8dd8-4c85-807d-d33c033c6a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Flow 'volume_create_manager' (80a9676d-049a-4009-be90-ba3ba3ce084a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:55 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-df54528e-550f-4617-96fd-af8e421bc831 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Created volume successfully.
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-c87e2317-42ae-402f-b9cd-100de593932d" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-c87e2317-42ae-402f-b9cd-100de593932d" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce84316-cdf8-4357-9aef-820abd12781b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:55 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d
Apr 29 08:36:55 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:56 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01caa92-d99a-4fa0-8172-2be7741f24f0]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:56 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b
Apr 29 08:36:56 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:56 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d" returned: 0 in 0.987s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:56 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d
Apr 29 08:36:56 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:57 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" returned: 0 in 1.087s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:57 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c87e2317-42ae-402f-b9cd-100de593932d" returned: 0 in 0.813s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-c87e2317-42ae-402f-b9cd-100de593932d" released by "delete_volume" :: held 1.866s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:57 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['4fb2fef8-8c31-49fe-8fda-3e770ce872c8'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:57 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b
Apr 29 08:36:57 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:57 devstack cinder-volume[83885]: WARNING cinder.quota [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-308552032 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-308552032, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:57 devstack cinder-volume[83885]: WARNING cinder.quota [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-308552032 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-308552032, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:57 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['dd990690-d3f8-478e-b964-d54c8f0b7b83', 'ce3c183a-76c0-40ec-94e7-ed72961c6481', '33a03086-f5ef-4483-b9d0-90474483f9b7', '066ceb2b-aa61-4e4f-be57-0a27c5d669f4'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:58 devstack sudo[88178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:36:58 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:58 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" returned: 1 in 0.906s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.054s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9', 'name': 'volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea635bbf-53cc-4978-b6f8-4d449b249611', 'enforce_multipath': True} {{(pid=83885) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 08:36:58 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-4ab0cea0-9326-4080-ba35-93f2e1d0926f req-cdcf78c5-0bc3-47a8-9841-a121683b81a7 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] attachment_update completed successfully.
Apr 29 08:36:58 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.754s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:58 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:58 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-32a23823-7368-4aa1-9d88-2e7aa12e3ed6 tempest-GroupSnapshotsTest-2121115982 None] Delete group completed successfully.
Apr 29 08:36:59 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] group_snapshot 4466dd5e-bd9d-4248-aca2-edc48f387c06: deleting
Apr 29 08:36:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] group_snapshot 4466dd5e-bd9d-4248-aca2-edc48f387c06: deleting {{(pid=83885) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 08:36:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-787c3933-808b-41ce-8b3d-81a5211e34f9" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-787c3933-808b-41ce-8b3d-81a5211e34f9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Deleting offline snapshot efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 of volume 787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:36:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] snapshot_file for this snap is: volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:36:59 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b9a946-2057-4aa9-aa01-9976ac391e33]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:59 devstack sudo[88184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1
Apr 29 08:36:59 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:00 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1" returned: 0 in 1.059s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787c3933-808b-41ce-8b3d-81a5211e34f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:00 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2968fd76-2cb6-40c6-9e5d-545b7607d8e6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:00 devstack sudo[88189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9
Apr 29 08:37:00 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9" returned: 0 in 1.020s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:01 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:01 devstack sudo[88195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1
Apr 29 08:37:01 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b4e14367-f3f2-4218-809b-c15973ea9673 tempest-GroupsV320Test-1819664027 None] Group tempest-GroupsV320Test-Group-1893282374: creating
Apr 29 08:37:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b4e14367-f3f2-4218-809b-c15973ea9673 tempest-GroupsV320Test-1819664027 None] Group tempest-GroupsV320Test-Group-1893282374: created successfully
Apr 29 08:37:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b4e14367-f3f2-4218-809b-c15973ea9673 tempest-GroupsV320Test-1819664027 None] Create group completed successfully.
Apr 29 08:37:02 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1" returned: 0 in 0.871s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:02 devstack sudo[88203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1
Apr 29 08:37:02 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:03 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9.efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1" returned: 0 in 0.748s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-efb25a5f-83f1-4e6c-a0e5-3f9db3d8aeb1" released by "_delete_snapshot" :: held 3.864s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-787c3933-808b-41ce-8b3d-81a5211e34f9" released by "delete_snapshot" :: held 3.905s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:03 devstack cinder-volume[83885]: WARNING cinder.quota [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-308552032 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-308552032, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['cedf5cdd-0006-4e9f-833d-a4ec59b72216', 'a351c38f-a6fd-4c98-91b7-e7f93fdbb069', '8143df0f-1afb-4986-a84f-8e6303cdc929', '1e8d4812-b758-4aa9-90c1-48bb4fe5eb07'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:03 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3a4f81db-ce0d-4359-af6a-8de373789dd9 tempest-GroupSnapshotsTest-2121115982 None] group_snapshot 4466dd5e-bd9d-4248-aca2-edc48f387c06: deleted successfully
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] Created reservations ['fbc594de-8d7b-41f5-b590-31091cf42834'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:03 devstack sudo[88233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:37:03 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-787c3933-808b-41ce-8b3d-81a5211e34f9" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-787c3933-808b-41ce-8b3d-81a5211e34f9" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:04 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175e0f0-3c6a-44a4-85d2-bedf88f83986]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:04 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9
Apr 29 08:37:04 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:04 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.243s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:04 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:04 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e7e14ffb-147a-4e12-ab45-b806bfaf9e97 tempest-GroupsV320Test-1819664027 None] Delete group completed successfully.
Apr 29 08:37:05 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9" returned: 0 in 1.680s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:05 devstack sudo[88251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9
Apr 29 08:37:05 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:07 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-787c3933-808b-41ce-8b3d-81a5211e34f9" returned: 0 in 1.450s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-787c3933-808b-41ce-8b3d-81a5211e34f9" released by "delete_volume" :: held 3.240s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['87dfedda-b490-4779-a0a3-7231e33409d2'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:07 devstack cinder-volume[83885]: WARNING cinder.db.sqlalchemy.api [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-308552032']
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['cf57035c-fb37-42b8-b920-e7454cb44e8c', '1389aa2a-029d-404b-afde-70718a5bb8be', '82e0b39f-af80-4483-b20b-d99e6544e8ed', 'd60aca36-a361-4462-a348-c0e0e29bfa33'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:07 devstack sudo[88255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:37:07 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:08 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.230s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:08 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:08 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c0a74443-2e9a-4265-9762-0784bd5c7897 tempest-GroupSnapshotsTest-2121115982 None] Delete group completed successfully.
Apr 29 08:37:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-42c34203-e2b1-464f-825e-ac6fe95b117a tempest-GroupSnapshotsTest-2121115982 None] Group tempest-GroupSnapshotsTest-Group-1227849100: creating
Apr 29 08:37:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-42c34203-e2b1-464f-825e-ac6fe95b117a tempest-GroupSnapshotsTest-2121115982 None] Group tempest-GroupSnapshotsTest-Group-1227849100: created successfully
Apr 29 08:37:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-42c34203-e2b1-464f-825e-ac6fe95b117a tempest-GroupSnapshotsTest-2121115982 None] Create group completed successfully.
Apr 29 08:37:11 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:37:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Flow 'volume_create_manager' (0be0f0e7-f0b4-406d-8759-3a6b5dbead92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121a5afb-8c5d-45ef-826c-1dbd1a721506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121a5afb-8c5d-45ef-826c-1dbd1a721506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011165379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7ae7edfd-8ef8-40d9-b97b-1f9d89c97525,host='devstack@QuobyteHD#QuobyteHD',id=35688898-f688-4bc0-a0f4-991d13f8fbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae85ab8d4e84b1683510348905a3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:12Z,use_quota=True,user_id='3c22988ce12645fc8c98445b58e08956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bed1d977-0fd1-4d6b-a3d1-cc0f92317bb8),volume_type_id=bed1d977-0fd1-4d6b-a3d1-cc0f92317bb8)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3da23a5-d9fa-4503-94b6-8a40e3f8e7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3da23a5-d9fa-4503-94b6-8a40e3f8e7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe04fb01-2678-4b8e-af69-ff81e72d4fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe04fb01-2678-4b8e-af69-ff81e72d4fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35688898-f688-4bc0-a0f4-991d13f8fbc0', 'volume_name': 'volume-35688898-f688-4bc0-a0f4-991d13f8fbc0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d704f4-0949-4656-91ba-9ec74dfdd700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d704f4-0949-4656-91ba-9ec74dfdd700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc2a794-4b8a-44ca-ae0c-418af464b96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:12 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Volume 35688898-f688-4bc0-a0f4-991d13f8fbc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35688898-f688-4bc0-a0f4-991d13f8fbc0', 'volume_size': 1}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7ae7edfd-8ef8-40d9-b97b-1f9d89c97525,created_at=2026-04-29T06:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011165379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7ae7edfd-8ef8-40d9-b97b-1f9d89c97525,host='devstack@QuobyteHD#QuobyteHD',id=35688898-f688-4bc0-a0f4-991d13f8fbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae85ab8d4e84b1683510348905a3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:12Z,use_quota=True,user_id='3c22988ce12645fc8c98445b58e08956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bed1d977-0fd1-4d6b-a3d1-cc0f92317bb8),volume_type_id=bed1d977-0fd1-4d6b-a3d1-cc0f92317bb8)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Creating volume 35688898-f688-4bc0-a0f4-991d13f8fbc0 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:12 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:37:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:12 devstack sudo[88272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 1073741824
Apr 29 08:37:12 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:14 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 1073741824" returned: 0 in 2.017s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:14 devstack sudo[88279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0
Apr 29 08:37:14 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:15 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0" returned: 0 in 1.130s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:15 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] <== create_volume: return (3248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:37:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.265s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:15 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc2a794-4b8a-44ca-ae0c-418af464b96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35688898-f688-4bc0-a0f4-991d13f8fbc0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:15 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccb0a33-0cc6-46a2-9e85-5cdee971d7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:15 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Volume volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 (35688898-f688-4bc0-a0f4-991d13f8fbc0): created successfully
Apr 29 08:37:15 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccb0a33-0cc6-46a2-9e85-5cdee971d7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:15 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Flow 'volume_create_manager' (0be0f0e7-f0b4-406d-8759-3a6b5dbead92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:15 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a8e7f766-96cb-42e0-9a6a-d0ee4a5e093f tempest-GroupSnapshotsTest-2121115982 None] Created volume successfully.
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=128,cinder:SELECT=125,cinder:DELETE=8,cinder:INSERT=32 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Flow 'volume_create_manager' (347ca7df-be14-4598-946c-c740f9614a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08b5887-46b0-4295-b963-37daf4eac4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08b5887-46b0-4295-b963-37daf4eac4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-522891084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7ae7edfd-8ef8-40d9-b97b-1f9d89c97525,host='devstack@QuobyteHD#QuobyteHD',id=36c6c496-4456-4e5d-8508-9f8ab793bb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae85ab8d4e84b1683510348905a3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:17Z,use_quota=True,user_id='3c22988ce12645fc8c98445b58e08956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bed1d977-0fd1-4d6b-a3d1-cc0f92317bb8),volume_type_id=bed1d977-0fd1-4d6b-a3d1-cc0f92317bb8)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bda216-cea3-4c1a-9c12-fc1d92caf8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bda216-cea3-4c1a-9c12-fc1d92caf8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e72435b-bd75-4c65-badd-5a62d51ae6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e72435b-bd75-4c65-badd-5a62d51ae6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c6c496-4456-4e5d-8508-9f8ab793bb4a', 'volume_name': 'volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e69b23d-021c-4bd4-b545-a7572c395f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e69b23d-021c-4bd4-b545-a7572c395f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7394c1b0-a096-400b-a919-bfa59262d937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:17 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Volume 36c6c496-4456-4e5d-8508-9f8ab793bb4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a', 'volume_size': 1}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7ae7edfd-8ef8-40d9-b97b-1f9d89c97525,created_at=2026-04-29T06:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-522891084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7ae7edfd-8ef8-40d9-b97b-1f9d89c97525,host='devstack@QuobyteHD#QuobyteHD',id=36c6c496-4456-4e5d-8508-9f8ab793bb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae85ab8d4e84b1683510348905a3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:17Z,use_quota=True,user_id='3c22988ce12645fc8c98445b58e08956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bed1d977-0fd1-4d6b-a3d1-cc0f92317bb8),volume_type_id=bed1d977-0fd1-4d6b-a3d1-cc0f92317bb8)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Creating volume 36c6c496-4456-4e5d-8508-9f8ab793bb4a {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:17 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:37:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:17 devstack sudo[88313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a 1073741824
Apr 29 08:37:17 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:18 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a 1073741824" returned: 0 in 1.321s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:18 devstack sudo[88355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a
Apr 29 08:37:18 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:19 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a" returned: 0 in 0.869s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:37:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7394c1b0-a096-400b-a919-bfa59262d937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab522ab-3c37-431b-a803-580f00ec75f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:19 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Volume volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a (36c6c496-4456-4e5d-8508-9f8ab793bb4a): created successfully
Apr 29 08:37:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab522ab-3c37-431b-a803-580f00ec75f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Flow 'volume_create_manager' (347ca7df-be14-4598-946c-c740f9614a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3f5f5600-fdfb-4c6c-941d-3d953899b948 tempest-GroupSnapshotsTest-2121115982 None] Created volume successfully.
Apr 29 08:37:21 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-9d29270c-ff0a-47c7-97f8-180047b498e9 tempest-GroupSnapshotsTest-2121115982 None] Update group completed successfully.
Apr 29 08:37:22 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-63034bc2-8ff9-4201-8a51-fe6c369f8ce7 tempest-GroupSnapshotsTest-2121115982 None] Update group completed successfully.
Apr 29 08:37:23 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=130,cinder:UPDATE=115,cinder:INSERT=32,cinder:DELETE=3 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:37:23 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-61769b39-53e9-433f-9ae2-5251d1eeadab tempest-GroupSnapshotsTest-2121115982 None] Update group completed successfully.
Apr 29 08:37:24 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5d743b7f-3b98-4791-a1df-b69c83345fd4 tempest-GroupSnapshotsTest-2121115982 None] Update group completed successfully.
Apr 29 08:37:26 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] GroupSnapshot fdfc8a92-cfd7-4e59-9640-bd55f5af0d72: creating.
Apr 29 08:37:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Group snapshot fdfc8a92-cfd7-4e59-9640-bd55f5af0d72: creating. {{(pid=83885) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 08:37:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Creating offline snapshot 2db46814-90b4-4c56-8063-b376f21f594d of volume 36c6c496-4456-4e5d-8508-9f8ab793bb4a {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:37:26 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40c074d-7c81-4921-8fa3-fa1bb6207753]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:26 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a
Apr 29 08:37:26 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:27 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a" returned: 0 in 1.075s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:27 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d 1G
Apr 29 08:37:27 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:29 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d 1G" returned: 0 in 1.535s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:29 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d
Apr 29 08:37:29 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:30 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d" returned: 0 in 1.151s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:30 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:30 devstack sudo[88435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d
Apr 29 08:37:30 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:31 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d" returned: 0 in 1.061s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:31 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.info
Apr 29 08:37:31 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Flow 'volume_create_manager' (e1eac4c1-0345-4b85-b1ed-3dad8030a911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1c5851-326b-42d1-8273-9d3271afc161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1c5851-326b-42d1-8273-9d3271afc161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-700713314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85335090-aeb7-4b25-a676-4fbe08f3ef16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cdc9be50a6456eb06d2ed2f20edd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:32Z,use_quota=True,user_id='1f81cc785c2244e592655073738913e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b70a4dc-6c09-4889-b2b4-56d2db53f0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b70a4dc-6c09-4889-b2b4-56d2db53f0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c412e9d-2d7f-44cd-837f-c3cc0987fe37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.image.glance [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Creating Keystone auth plugin from conf {{(pid=83885) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c412e9d-2d7f-44cd-837f-c3cc0987fe37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85335090-aeb7-4b25-a676-4fbe08f3ef16', 'volume_name': 'volume-85335090-aeb7-4b25-a676-4fbe08f3ef16', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e57a6c0>}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cf653c-cf56-40ff-a81a-7983707b495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cf653c-cf56-40ff-a81a-7983707b495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fe9114-c462-4ff4-9ee7-5f8989b9228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:32 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Volume 85335090-aeb7-4b25-a676-4fbe08f3ef16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85335090-aeb7-4b25-a676-4fbe08f3ef16', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e57a6c0>}
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Trying to clone 85335090-aeb7-4b25-a676-4fbe08f3ef16 from image b7d8ee2a-d63e-4da9-983e-f810d728a919 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]). {{(pid=83885) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Apr 29 08:37:32 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.info" returned: 0 in 1.154s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:32 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:32 devstack sudo[88479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.info
Apr 29 08:37:32 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 08:37:33 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39dbf3e-8033-41d2-a9b4-03065f401338]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:33 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD
Apr 29 08:37:33 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:33 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.info" returned: 0 in 1.161s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.276s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Creating offline snapshot ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 of volume 35688898-f688-4bc0-a0f4-991d13f8fbc0 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea258fa-c79c-453e-a558-7bbdc73c5be0]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:34 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0
Apr 29 08:37:34 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:34 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD" returned: 0 in 0.882s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:34 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Temporary image b7d8ee2a-d63e-4da9-983e-f810d728a919 is fetched for user 1f81cc785c2244e592655073738913e2. {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 08:37:34 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b2d2b8-816f-43a0-bd00-462ecfa29ce2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:34 devstack sudo[88539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD
Apr 29 08:37:34 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:34 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0" returned: 0 in 0.964s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:34 devstack sudo[88545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 1G
Apr 29 08:37:34 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:35 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD" returned: 0 in 0.907s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:36 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 1G" returned: 0 in 1.110s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:36 devstack sudo[88554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74
Apr 29 08:37:36 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:36 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74" returned: 0 in 0.674s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:36 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:36 devstack sudo[88559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74
Apr 29 08:37:36 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:37 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74" returned: 0 in 0.803s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:37 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.info
Apr 29 08:37:37 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:38 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.info" returned: 0 in 0.695s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:38 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:38 devstack sudo[88597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.info
Apr 29 08:37:38 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:39 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.info" returned: 0 in 0.802s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.203s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.787s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-700713314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85335090-aeb7-4b25-a676-4fbe08f3ef16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cdc9be50a6456eb06d2ed2f20edd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:32Z,use_quota=True,user_id='1f81cc785c2244e592655073738913e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Creating volume 85335090-aeb7-4b25-a676-4fbe08f3ef16 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:39 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:39 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 1073741824
Apr 29 08:37:39 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:39 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-45aeab94-551b-412e-82b7-842461a86785 tempest-GroupSnapshotsTest-2121115982 None] group_snapshot fdfc8a92-cfd7-4e59-9640-bd55f5af0d72: created successfully
Apr 29 08:37:39 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] group_snapshot fdfc8a92-cfd7-4e59-9640-bd55f5af0d72: deleting
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] group_snapshot fdfc8a92-cfd7-4e59-9640-bd55f5af0d72: deleting {{(pid=83885) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-36c6c496-4456-4e5d-8508-9f8ab793bb4a" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-36c6c496-4456-4e5d-8508-9f8ab793bb4a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-2db46814-90b4-4c56-8063-b376f21f594d" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-2db46814-90b4-4c56-8063-b376f21f594d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Deleting offline snapshot 2db46814-90b4-4c56-8063-b376f21f594d of volume 36c6c496-4456-4e5d-8508-9f8ab793bb4a {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] snapshot_file for this snap is: volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4d5880-fb7c-4765-a437-e93f86cee1f6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:39 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-d404c9ef-3c4f-4f24-acfd-5da8af168169 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Terminate volume connection completed successfully.
Apr 29 08:37:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-d404c9ef-3c4f-4f24-acfd-5da8af168169 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Deleting attachment ea635bbf-53cc-4978-b6f8-4d449b249611. {{(pid=83885) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 08:37:40 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d
Apr 29 08:37:40 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:40 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 1073741824" returned: 0 in 1.014s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:40 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16
Apr 29 08:37:40 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "cinder-abd53f8f-0af6-4ecb-a64c-6122ad823f1b-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "cinder-abd53f8f-0af6-4ecb-a64c-6122ad823f1b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "cinder-quobyte-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "cinder-quobyte-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:40 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d" returned: 0 in 0.868s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[403d0b95-b797-49b9-bcd4-992c76884ef8]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b81f63-bbba-46a9-91e1-880531d723ef]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:40 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16" returned: 0 in 0.684s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Attempting download of b7d8ee2a-d63e-4da9-983e-f810d728a919 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}])) to volume 85335090-aeb7-4b25-a676-4fbe08f3ef16. {{(pid=83885) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b395376-ee8f-4e1e-a14e-5f4a2498e8e8]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_hljpw5z2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:40 devstack sudo[88632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b
Apr 29 08:37:40 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:40 devstack sudo[88633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a
Apr 29 08:37:40 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:41 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_hljpw5z2
Apr 29 08:37:41 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:41 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a" returned: 0 in 0.833s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:41 devstack sudo[88645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d
Apr 29 08:37:41 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:41 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" returned: 0 in 0.910s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:41 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_hljpw5z2" returned: 0 in 0.874s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_hljpw5z2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:41 devstack sudo[88647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b
Apr 29 08:37:41 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:41 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_hljpw5z2
Apr 29 08:37:41 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:42 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d" returned: 0 in 0.822s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:42 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d
Apr 29 08:37:42 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:42 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_hljpw5z2" returned: 1 in 0.781s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_hljpw5z2' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:37:42 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e553d741-4eb9-4c9d-94cb-5e8bfcd9fc47]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:42 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" returned: 1 in 0.885s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:37:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:42 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b
Apr 29 08:37:42 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:42 devstack sudo[88661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD
Apr 29 08:37:42 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:43 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" returned: 0 in 0.692s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "cinder-quobyte-abd53f8f-0af6-4ecb-a64c-6122ad823f1b" released by "delete_volume" :: held 2.576s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:43 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a.2db46814-90b4-4c56-8063-b376f21f594d" returned: 0 in 0.853s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-2db46814-90b4-4c56-8063-b376f21f594d" released by "_delete_snapshot" :: held 3.500s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-36c6c496-4456-4e5d-8508-9f8ab793bb4a" released by "delete_snapshot" :: held 3.536s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-35688898-f688-4bc0-a0f4-991d13f8fbc0" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-35688898-f688-4bc0-a0f4-991d13f8fbc0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-ff00d985-cfaf-4200-a3e3-3a9b0ff24b74" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.quota [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Created reservations ['d885f83e-38e8-4a65-8650-b21f224f641d', 'fe547c98-09d9-47d9-b113-5a0dc7efff43', 'fe81f83e-525f-4dbd-a0c7-2fa78fb254cf', '8f70ed8e-a50a-4ac3-8095-f87543a24b96'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-ff00d985-cfaf-4200-a3e3-3a9b0ff24b74" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Deleting offline snapshot ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 of volume 35688898-f688-4bc0-a0f4-991d13f8fbc0 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] snapshot_file for this snap is: volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:37:43 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD" returned: 0 in 0.895s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] b7d8ee2a-d63e-4da9-983e-f810d728a919 was qcow2, converting to raw {{(pid=83885) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75eb0aa-b575-452a-88be-de353ce6e7b9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:43 devstack sudo[88675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16
Apr 29 08:37:43 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:43 devstack sudo[88678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:37:43 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:43 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74
Apr 29 08:37:43 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:44 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.802s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:44 devstack cinder-volume[83885]: DEBUG cinder.manager [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:44 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Deleted volume successfully.
Apr 29 08:37:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-453d51cb-002f-4bd5-b643-b8e102eed83f req-15ff9ad4-cfe5-47a0-b727-2ee6c9319b49 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "cinder-abd53f8f-0af6-4ecb-a64c-6122ad823f1b-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:44 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74" returned: 0 in 1.023s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35688898-f688-4bc0-a0f4-991d13f8fbc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:44 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd7a3e7-97c4-466f-96ac-f830ba337760]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:44 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0
Apr 29 08:37:44 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:46 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0" returned: 0 in 1.512s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:46 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74
Apr 29 08:37:46 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:46 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16" returned: 0 in 3.436s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:46 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_amijql82devstack@QuobyteHD, size 112.00 MB, duration 3.44 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:37:46 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Converted 112.00 MB image at 32.58 MB/s
Apr 29 08:37:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:46 devstack sudo[88798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 1G
Apr 29 08:37:46 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:47 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74" returned: 0 in 1.339s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:47 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74
Apr 29 08:37:47 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:48 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 1G" returned: 0 in 1.262s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:48 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[951990f4-ae93-46f4-8ecf-153cbc27d717]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:48 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16
Apr 29 08:37:48 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:48 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0.ff00d985-cfaf-4200-a3e3-3a9b0ff24b74" returned: 0 in 1.499s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-ff00d985-cfaf-4200-a3e3-3a9b0ff24b74" released by "_delete_snapshot" :: held 5.513s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-35688898-f688-4bc0-a0f4-991d13f8fbc0" released by "delete_snapshot" :: held 5.554s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:49 devstack cinder-volume[83885]: WARNING cinder.quota [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-473509383 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-473509383, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:37:49 devstack cinder-volume[83885]: WARNING cinder.quota [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-473509383 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-473509383, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['f929fe74-710f-426f-b339-f693ff1bb72f', 'c60df3c7-aae0-4d62-b971-c00fc6f2a555', '675db901-9573-4cf4-8728-7345101065f7', '064173c1-18a2-4dc4-93a8-1b8459374649'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['d5c68cc1-c0b8-48ba-b968-86a15e9731a7', '292253ea-561d-4a06-a40c-7885725d8d18', '189314ec-da81-43a2-afdd-713014825fac', '891ff931-df12-4d78-b74b-ccbe3be954df'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:49 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d0d40ac6-6403-422c-a3f2-0640a53a725a tempest-GroupSnapshotsTest-2121115982 None] group_snapshot fdfc8a92-cfd7-4e59-9640-bd55f5af0d72: deleted successfully
Apr 29 08:37:49 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16" returned: 0 in 1.202s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:49 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16
Apr 29 08:37:49 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:49 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:37:49 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-35688898-f688-4bc0-a0f4-991d13f8fbc0" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-35688898-f688-4bc0-a0f4-991d13f8fbc0" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[144cff39-6e58-4e3d-9cc6-fb7521c21163]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:50 devstack sudo[88836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0
Apr 29 08:37:50 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:50 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16" returned: 1 in 1.417s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Downloaded image b7d8ee2a-d63e-4da9-983e-f810d728a919 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}])) to volume 85335090-aeb7-4b25-a676-4fbe08f3ef16 successfully. {{(pid=83885) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Temporary image b7d8ee2a-d63e-4da9-983e-f810d728a919 for user 1f81cc785c2244e592655073738913e2 is deleted. {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Marking volume 85335090-aeb7-4b25-a676-4fbe08f3ef16 as bootable. {{(pid=83885) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (8a7fb223-1246-4813-923a-8893903815cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f206158-214a-4b00-a1cb-7352da565992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Copying metadata from image b7d8ee2a-d63e-4da9-983e-f810d728a919 to 85335090-aeb7-4b25-a676-4fbe08f3ef16. {{(pid=83885) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Creating volume glance metadata for volume 85335090-aeb7-4b25-a676-4fbe08f3ef16 backed by image b7d8ee2a-d63e-4da9-983e-f810d728a919 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83885) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f206158-214a-4b00-a1cb-7352da565992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1507046168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cdefbb-6530-4c8e-8191-48c8916ccdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:51Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f714220d-1199-4bb7-827b-2fab5e85be73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f714220d-1199-4bb7-827b-2fab5e85be73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e52191c-99ef-4d82-9123-33207fa2455e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e52191c-99ef-4d82-9123-33207fa2455e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96cdefbb-6530-4c8e-8191-48c8916ccdb0', 'volume_name': 'volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7e9b8d-1cae-49d3-8d2a-9d0fa1834808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7e9b8d-1cae-49d3-8d2a-9d0fa1834808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8ad07c-911f-4d21-af35-73df616a9a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:50 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Volume 96cdefbb-6530-4c8e-8191-48c8916ccdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0', 'volume_size': 1}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1507046168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cdefbb-6530-4c8e-8191-48c8916ccdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:51Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Creating volume 96cdefbb-6530-4c8e-8191-48c8916ccdb0 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:51 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:51 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0 1073741824
Apr 29 08:37:51 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fe9114-c462-4ff4-9ee7-5f8989b9228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85335090-aeb7-4b25-a676-4fbe08f3ef16', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e57a6c0>}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14e61e3-946c-4f02-abb5-1320e5d38b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:51 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Volume volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 (85335090-aeb7-4b25-a676-4fbe08f3ef16): created successfully
Apr 29 08:37:51 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14e61e3-946c-4f02-abb5-1320e5d38b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Flow 'volume_create_manager' (e1eac4c1-0345-4b85-b1ed-3dad8030a911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.518s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:51 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-24ab9cd9-5938-4c53-94f9-09940e950baf tempest-VolumesImageMetadata-167316894 None] Created volume successfully.
Apr 29 08:37:51 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0" returned: 0 in 1.364s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:51 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0
Apr 29 08:37:51 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:51 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0 1073741824" returned: 0 in 0.881s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:51 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0
Apr 29 08:37:51 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:52 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-35688898-f688-4bc0-a0f4-991d13f8fbc0" returned: 0 in 0.782s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-35688898-f688-4bc0-a0f4-991d13f8fbc0" released by "delete_volume" :: held 2.260s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-36c6c496-4456-4e5d-8508-9f8ab793bb4a" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-36c6c496-4456-4e5d-8508-9f8ab793bb4a" acquired by "delete_volume" :: waited 0.038s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Acquiring lock "cinder-85335090-aeb7-4b25-a676-4fbe08f3ef16-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3081b90e-12fb-440c-95cb-ac07117e6c46]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Lock "cinder-85335090-aeb7-4b25-a676-4fbe08f3ef16-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Acquiring lock "cinder-quobyte-85335090-aeb7-4b25-a676-4fbe08f3ef16" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Lock "cinder-quobyte-85335090-aeb7-4b25-a676-4fbe08f3ef16" acquired by "delete_volume" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:52 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a
Apr 29 08:37:52 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6535fa25-1410-49af-86b3-8470fe315287]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:53 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16
Apr 29 08:37:53 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:53 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0" returned: 0 in 1.149s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8ad07c-911f-4d21-af35-73df616a9a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c6d4f0-1191-46d5-87a9-c7c50ab06486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:53 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Volume volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0 (96cdefbb-6530-4c8e-8191-48c8916ccdb0): created successfully
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c6d4f0-1191-46d5-87a9-c7c50ab06486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (8a7fb223-1246-4813-923a-8893903815cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:53 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-9ade7f82-df7c-4888-bd94-fc9a0ccf3efe tempest-VolumesActionsTest-471946475 None] Created volume successfully.
Apr 29 08:37:53 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a" returned: 0 in 1.279s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:53 devstack sudo[88869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a
Apr 29 08:37:53 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:53 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16" returned: 0 in 1.050s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:53 devstack sudo[88871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16
Apr 29 08:37:53 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-55c0e718-51c7-4c4f-956c-83df480f4690 tempest-VolumesActionsTest-471946475 None] Acquiring lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0" by "attach_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-55c0e718-51c7-4c4f-956c-83df480f4690 tempest-VolumesActionsTest-471946475 None] Lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0" acquired by "attach_volume" :: waited 0.056s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:54 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-55c0e718-51c7-4c4f-956c-83df480f4690 tempest-VolumesActionsTest-471946475 None] Attaching volume 96cdefbb-6530-4c8e-8191-48c8916ccdb0 to instance 2651d8b3-bc7c-4e5b-a22f-3c236f01a1c2 at mountpoint /dev/vdb on host None.
Apr 29 08:37:54 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-55c0e718-51c7-4c4f-956c-83df480f4690 tempest-VolumesActionsTest-471946475 None] Attach volume completed successfully.
Apr 29 08:37:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-55c0e718-51c7-4c4f-956c-83df480f4690 tempest-VolumesActionsTest-471946475 None] Lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0" released by "attach_volume" :: held 0.317s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:54 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-36c6c496-4456-4e5d-8508-9f8ab793bb4a" returned: 0 in 1.164s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-36c6c496-4456-4e5d-8508-9f8ab793bb4a" released by "delete_volume" :: held 2.559s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['6bddadbc-fe03-47fc-b662-1789b707efb8'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:55 devstack cinder-volume[83885]: WARNING cinder.quota [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-473509383 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-473509383, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['37add0e1-21de-438c-b2b4-54055c590f43', 'd0c19a14-4006-4991-b5fe-2b3ae6685857', '5bd82cc1-12b4-4f1a-b27f-6522d07dbdb5', '1f6f7b74-bb6c-4baf-b5c6-7ecfb8cc540d'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:55 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16" returned: 1 in 1.576s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:55 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16
Apr 29 08:37:55 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['3b838b53-ce70-49c2-8d02-a64def575b4d', '2937856f-032b-4462-85c4-f8e82a80e30d', '4d39df3a-3fd8-4c70-9357-08e70a8d4230', '2698e518-0c3c-401c-9b82-556f3842eb65'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:55 devstack sudo[88910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:37:55 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6dec7d06-ee23-4ded-ad65-a81cede5c98e tempest-VolumesActionsTest-1109330196 None] Terminate volume connection completed successfully.
Apr 29 08:37:56 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-85335090-aeb7-4b25-a676-4fbe08f3ef16" returned: 0 in 1.036s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Lock "cinder-quobyte-85335090-aeb7-4b25-a676-4fbe08f3ef16" released by "delete_volume" :: held 3.833s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6dec7d06-ee23-4ded-ad65-a81cede5c98e tempest-VolumesActionsTest-1109330196 None] Acquiring lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0-detach_volume" by "detach_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Created reservations ['ba27f2fd-6a81-497b-9178-94fdc3385d94', '57fb25e4-e043-4167-9696-eb84ca29c12d', 'a7e41560-8c4e-45d7-a6b0-09de41f8e6c9', '3a895da6-1c89-430f-926e-fe06a9014078'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6dec7d06-ee23-4ded-ad65-a81cede5c98e tempest-VolumesActionsTest-1109330196 None] Lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0-detach_volume" acquired by "detach_volume" :: waited 0.071s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6dec7d06-ee23-4ded-ad65-a81cede5c98e tempest-VolumesActionsTest-1109330196 None] Detaching volume 96cdefbb-6530-4c8e-8191-48c8916ccdb0 from instance 2651d8b3-bc7c-4e5b-a22f-3c236f01a1c2.
Apr 29 08:37:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6dec7d06-ee23-4ded-ad65-a81cede5c98e tempest-VolumesActionsTest-1109330196 None] Detach volume completed successfully.
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6dec7d06-ee23-4ded-ad65-a81cede5c98e tempest-VolumesActionsTest-1109330196 None] Lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0-detach_volume" released by "detach_volume" :: held 0.158s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:57 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.158s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:57 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:57 devstack sudo[88916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:37:57 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-f0dab082-b061-46d0-a339-afcd04a9eea6 tempest-GroupSnapshotsTest-2121115982 None] Delete group completed successfully.
Apr 29 08:37:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-16009500-9d4c-4f1c-b434-f25f6a275d3c tempest-GroupSnapshotsTest-2121115982 None] Group tempest-GroupSnapshotsTest-Group-606833943: creating
Apr 29 08:37:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-16009500-9d4c-4f1c-b434-f25f6a275d3c tempest-GroupSnapshotsTest-2121115982 None] Group tempest-GroupSnapshotsTest-Group-606833943: created successfully
Apr 29 08:37:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-16009500-9d4c-4f1c-b434-f25f6a275d3c tempest-GroupSnapshotsTest-2121115982 None] Create group completed successfully.
Apr 29 08:37:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-03c247f4-83ce-49cc-9195-972871745f02 tempest-VolumesActionsTest-471946475 None] Acquiring lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0-detach_volume" by "detach_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-03c247f4-83ce-49cc-9195-972871745f02 tempest-VolumesActionsTest-471946475 None] Lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-03c247f4-83ce-49cc-9195-972871745f02 tempest-VolumesActionsTest-471946475 None] Volume detach called, but volume not attached.
Apr 29 08:37:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-03c247f4-83ce-49cc-9195-972871745f02 tempest-VolumesActionsTest-471946475 None] Lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-84664927-47ca-4857-a9a7-c7b85b87f790 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Terminate volume connection completed successfully.
Apr 29 08:37:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-84664927-47ca-4857-a9a7-c7b85b87f790 tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Deleting attachment 3f63a5e7-0e30-4b46-94f1-465bf876135c. {{(pid=83885) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 08:37:57 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.765s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:57 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Deleted volume successfully.
Apr 29 08:37:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-229badf0-1026-4dd4-be8a-eb7561892881 tempest-VolumesImageMetadata-167316894 None] Lock "cinder-85335090-aeb7-4b25-a676-4fbe08f3ef16-delete_volume" released by "delete_volume" :: held 5.302s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Acquiring lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Acquiring lock "cinder-quobyte-96cdefbb-6530-4c8e-8191-48c8916ccdb0" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Lock "cinder-quobyte-96cdefbb-6530-4c8e-8191-48c8916ccdb0" acquired by "delete_volume" :: waited 0.031s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ee0c83-0a7b-49dd-b2ee-7b517f4a16c1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "cinder-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "cinder-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "cinder-quobyte-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "cinder-quobyte-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426" acquired by "delete_volume" :: waited 0.031s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9a6d59-f6bb-4cc2-86bd-980af3382ac5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:58 devstack sudo[88919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0
Apr 29 08:37:58 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:58 devstack sudo[88920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426
Apr 29 08:37:58 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Flow 'volume_create_manager' (9845562c-803c-4d40-9fa1-6d2242fc51d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b645a8-91d7-4554-9232-5a1755d91cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b645a8-91d7-4554-9232-5a1755d91cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1624993317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8f075983-0e36-4709-a826-8d7b0d9d1b60,host='devstack@QuobyteHD#QuobyteHD',id=2146e920-3541-418a-9a00-8c547f77cedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae85ab8d4e84b1683510348905a3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:59Z,use_quota=True,user_id='3c22988ce12645fc8c98445b58e08956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d45bc077-6e4e-4f55-a79e-ee0c486d3002),volume_type_id=d45bc077-6e4e-4f55-a79e-ee0c486d3002)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdbb0f2-d300-4b13-b746-ed69d313d960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdbb0f2-d300-4b13-b746-ed69d313d960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e6a6ac-14bd-450f-8997-80f5bf8f507c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e6a6ac-14bd-450f-8997-80f5bf8f507c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2146e920-3541-418a-9a00-8c547f77cedb', 'volume_name': 'volume-2146e920-3541-418a-9a00-8c547f77cedb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ae2b78-978d-4763-a62f-2c14a73f2d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ae2b78-978d-4763-a62f-2c14a73f2d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d041c874-88da-4704-bc03-d86c0463a1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:59 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Volume 2146e920-3541-418a-9a00-8c547f77cedb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2146e920-3541-418a-9a00-8c547f77cedb', 'volume_size': 1}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8f075983-0e36-4709-a826-8d7b0d9d1b60,created_at=2026-04-29T06:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1624993317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8f075983-0e36-4709-a826-8d7b0d9d1b60,host='devstack@QuobyteHD#QuobyteHD',id=2146e920-3541-418a-9a00-8c547f77cedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae85ab8d4e84b1683510348905a3b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:59Z,use_quota=True,user_id='3c22988ce12645fc8c98445b58e08956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d45bc077-6e4e-4f55-a79e-ee0c486d3002),volume_type_id=d45bc077-6e4e-4f55-a79e-ee0c486d3002)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Creating volume 2146e920-3541-418a-9a00-8c547f77cedb {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:59 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:59 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb 1073741824
Apr 29 08:37:59 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:59 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426" returned: 0 in 1.344s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:59 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0" returned: 0 in 1.570s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:00 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426
Apr 29 08:38:00 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:00 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0
Apr 29 08:38:00 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:00 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb 1073741824" returned: 0 in 1.268s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:00 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-96cdefbb-6530-4c8e-8191-48c8916ccdb0" returned: 0 in 0.914s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:00 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Lock "cinder-quobyte-96cdefbb-6530-4c8e-8191-48c8916ccdb0" released by "delete_volume" :: held 2.559s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426" returned: 0 in 0.966s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:00 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb
Apr 29 08:38:00 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "cinder-quobyte-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426" released by "delete_volume" :: held 2.372s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:00 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Created reservations ['14aac416-454f-40bb-8e5c-7945d8cc530e', '4ba35fc9-9094-422e-afa1-88e550488790', 'dacf574d-8750-425c-a9cc-ff1f23614156', '358c4abe-6dd9-4b95-8d3f-31c7a503daeb'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.quota [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Created reservations ['1a761242-c52e-4a29-9b5f-433bb49c6a5b', '75f491c9-47ae-40be-b99d-65b177c0d83e', '265d37d5-5563-447b-96a1-b989e2e2c087', '5f2d08de-c362-459a-b4e2-2cab3fcf7557'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:01 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:01 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:01 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:01 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:01 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb" returned: 0 in 0.855s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d041c874-88da-4704-bc03-d86c0463a1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2146e920-3541-418a-9a00-8c547f77cedb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b834c9d-a4c3-4821-9df2-fabddd1367f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:01 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Volume volume-2146e920-3541-418a-9a00-8c547f77cedb (2146e920-3541-418a-9a00-8c547f77cedb): created successfully
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b834c9d-a4c3-4821-9df2-fabddd1367f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Flow 'volume_create_manager' (9845562c-803c-4d40-9fa1-6d2242fc51d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:01 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-dfeef2fc-dfe8-4f2c-b7a8-84feaebf6298 tempest-GroupSnapshotsTest-2121115982 None] Created volume successfully.
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.820s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.manager [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:01 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Flow 'volume_create_manager' (58b63079-34be-4d9d-8e50-471cb00dcc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf9a681-590c-4e39-8f45-579ae6df486d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Deleted volume successfully.
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf9a681-590c-4e39-8f45-579ae6df486d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-831917120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c25a722-2458-4e40-b48e-89ecdeed1704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1234dffc89dc44ae94b0781ba1a82731',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:02Z,use_quota=True,user_id='eab3e45165b64a129baa4beebf8ab5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c776a8d7-73a0-4b9d-b0ad-378da33b12bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c776a8d7-73a0-4b9d-b0ad-378da33b12bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:02 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7e10f5-bb92-4bcc-bd2a-bd09b5b7913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7e10f5-bb92-4bcc-bd2a-bd09b5b7913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c25a722-2458-4e40-b48e-89ecdeed1704', 'volume_name': 'volume-5c25a722-2458-4e40-b48e-89ecdeed1704', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91c9e51-8b24-4f1a-af96-9b4cd96c902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91c9e51-8b24-4f1a-af96-9b4cd96c902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feea8b6e-522c-4659-9b6d-eeb2de72941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:02 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Volume 5c25a722-2458-4e40-b48e-89ecdeed1704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c25a722-2458-4e40-b48e-89ecdeed1704', 'volume_size': 1}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-831917120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c25a722-2458-4e40-b48e-89ecdeed1704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1234dffc89dc44ae94b0781ba1a82731',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:02Z,use_quota=True,user_id='eab3e45165b64a129baa4beebf8ab5f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Creating volume 5c25a722-2458-4e40-b48e-89ecdeed1704 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:02 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.018s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Deleted volume successfully.
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [req-cf670ffc-ed43-4268-9c56-9eaa62718f00 req-e412e45b-d1a6-4552-bba2-50132569f2ff tempest-ServerBootFromVolumeStableRescueTest-161262437 None] Lock "cinder-2b9fca7e-e502-4aa2-9ee5-d4dc0e2df426-delete_volume" released by "delete_volume" :: held 3.679s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:02 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704 1073741824
Apr 29 08:38:02 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bffb6c82-8f81-4142-a93f-44db945bb0f1 tempest-VolumesActionsTest-471946475 None] Lock "cinder-96cdefbb-6530-4c8e-8191-48c8916ccdb0-delete_volume" released by "delete_volume" :: held 3.906s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:03 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704 1073741824" returned: 0 in 0.918s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:03 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704
Apr 29 08:38:03 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:03 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] GroupSnapshot b4c936fa-2666-47fe-9d0e-9dab7f914391: creating.
Apr 29 08:38:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Group snapshot b4c936fa-2666-47fe-9d0e-9dab7f914391: creating. {{(pid=83885) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 08:38:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:04 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704" returned: 0 in 1.002s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.787s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feea8b6e-522c-4659-9b6d-eeb2de72941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c25a722-2458-4e40-b48e-89ecdeed1704', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3345a445-7484-4f90-8171-165d3a00e528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Creating offline snapshot 9847ed3a-5af6-4a25-81dc-c7f211892ee7 of volume 2146e920-3541-418a-9a00-8c547f77cedb {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[9903f284-46f2-4ab0-8723-635ba05afdfe]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:04 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Volume volume-5c25a722-2458-4e40-b48e-89ecdeed1704 (5c25a722-2458-4e40-b48e-89ecdeed1704): created successfully
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3345a445-7484-4f90-8171-165d3a00e528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Flow 'volume_create_manager' (58b63079-34be-4d9d-8e50-471cb00dcc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:04 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ab204c8c-4dad-4797-9bca-c9dd683226f6 tempest-VolumesMetadataTest-1967273343 None] Created volume successfully.
Apr 29 08:38:04 devstack sudo[89078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb
Apr 29 08:38:04 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb" returned: 0 in 0.860s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:05 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:05 devstack sudo[89086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 1G
Apr 29 08:38:05 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Acquiring lock "cinder-5c25a722-2458-4e40-b48e-89ecdeed1704-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Lock "cinder-5c25a722-2458-4e40-b48e-89ecdeed1704-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:06 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 1G" returned: 0 in 1.052s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2146e920-3541-418a-9a00-8c547f77cedb -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:06 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2146e920-3541-418a-9a00-8c547f77cedb -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7
Apr 29 08:38:06 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Acquiring lock "cinder-quobyte-5c25a722-2458-4e40-b48e-89ecdeed1704" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Lock "cinder-quobyte-5c25a722-2458-4e40-b48e-89ecdeed1704" acquired by "delete_volume" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d712e-2545-4190-bad1-b74fb3c77623]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:06 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704
Apr 29 08:38:06 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:06 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2146e920-3541-418a-9a00-8c547f77cedb -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7" returned: 0 in 0.741s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:06 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:06 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7
Apr 29 08:38:06 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:06 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704" returned: 0 in 0.769s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:06 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704
Apr 29 08:38:06 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:07 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7" returned: 0 in 0.633s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:07 devstack sudo[89110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.info
Apr 29 08:38:07 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:07 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5c25a722-2458-4e40-b48e-89ecdeed1704" returned: 0 in 0.653s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Lock "cinder-quobyte-5c25a722-2458-4e40-b48e-89ecdeed1704" released by "delete_volume" :: held 1.468s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Created reservations ['245d180e-4ceb-46e7-87a6-21a47336dd8e', 'c2e56873-7853-4e01-91f3-1138644927b2', 'a7249757-4e6d-4c8c-a314-34448c8da807', '41b9738b-67bb-42e5-bf0e-8d5093203b60'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:07 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:07 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:08 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.info" returned: 0 in 0.683s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:08 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:38:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:08 devstack sudo[89115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.info
Apr 29 08:38:08 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:08 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.645s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:08 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:08 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Deleted volume successfully.
Apr 29 08:38:08 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5117dcf0-2fa1-4daa-a3e9-2e70f72ef8cc tempest-VolumesMetadataTest-1967273343 None] Lock "cinder-5c25a722-2458-4e40-b48e-89ecdeed1704-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:08 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.info" returned: 0 in 0.654s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.745s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:08 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-edf0e899-73b5-4fa0-9841-ba88607cea40 tempest-GroupSnapshotsTest-2121115982 None] group_snapshot b4c936fa-2666-47fe-9d0e-9dab7f914391: created successfully
Apr 29 08:38:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] group_snapshot b4c936fa-2666-47fe-9d0e-9dab7f914391: deleting
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] group_snapshot b4c936fa-2666-47fe-9d0e-9dab7f914391: deleting {{(pid=83885) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-2146e920-3541-418a-9a00-8c547f77cedb" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-2146e920-3541-418a-9a00-8c547f77cedb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-9847ed3a-5af6-4a25-81dc-c7f211892ee7" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-9847ed3a-5af6-4a25-81dc-c7f211892ee7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Deleting offline snapshot 9847ed3a-5af6-4a25-81dc-c7f211892ee7 of volume 2146e920-3541-418a-9a00-8c547f77cedb {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] snapshot_file for this snap is: volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61fb64f-ba1a-4751-a550-49db3a29ef65]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:10 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7
Apr 29 08:38:10 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (a59dd3cc-85c7-4c58-a337-73c6f700b060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff296cad-b329-49f1-a8d1-dca993349e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff296cad-b329-49f1-a8d1-dca993349e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-103593833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:10Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4583ff3-1976-4440-9b47-d21d7cb385f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4583ff3-1976-4440-9b47-d21d7cb385f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea6cc40-2d4e-4fbc-8d4c-0d6ab55872bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea6cc40-2d4e-4fbc-8d4c-0d6ab55872bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2', 'volume_name': 'volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8915a103-7b8f-4dde-8d20-44ff144aea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8915a103-7b8f-4dde-8d20-44ff144aea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539cf577-e9ca-421c-9dab-510442ba3880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:10 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Volume ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2', 'volume_size': 1}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-103593833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:10Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Creating volume ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:10 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:10 devstack sudo[89123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2 1073741824
Apr 29 08:38:10 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:11 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7" returned: 0 in 0.931s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2146e920-3541-418a-9a00-8c547f77cedb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:11 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f041c84e-6931-4313-815e-392e2cee4160]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:11 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb
Apr 29 08:38:11 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:11 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2 1073741824" returned: 0 in 1.094s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:11 devstack sudo[89133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2
Apr 29 08:38:11 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:12 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb" returned: 0 in 0.921s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:12 devstack sudo[89138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7
Apr 29 08:38:12 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:12 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2" returned: 0 in 0.683s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539cf577-e9ca-421c-9dab-510442ba3880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d7b31c-ea67-4939-9eb8-1093aed6ce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:12 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Volume volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2 (ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2): created successfully
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d7b31c-ea67-4939-9eb8-1093aed6ce1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (a59dd3cc-85c7-4c58-a337-73c6f700b060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:12 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-adb8a108-2ea6-469d-8723-692098eb5bfe tempest-VolumesActionsTest-471946475 None] Created volume successfully.
Apr 29 08:38:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Acquiring lock "cinder-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:13 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Lock "cinder-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7" returned: 0 in 0.945s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:13 devstack sudo[89146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7
Apr 29 08:38:13 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Acquiring lock "cinder-quobyte-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Lock "cinder-quobyte-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a567bd83-9b41-4a57-b8d8-618ed45291eb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:13 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2
Apr 29 08:38:13 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:13 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb.9847ed3a-5af6-4a25-81dc-c7f211892ee7" returned: 0 in 0.738s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-9847ed3a-5af6-4a25-81dc-c7f211892ee7" released by "_delete_snapshot" :: held 3.737s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-2146e920-3541-418a-9a00-8c547f77cedb" released by "delete_snapshot" :: held 3.777s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Flow 'volume_create_manager' (4eefff70-d95c-4cd7-b57e-852f8ea5ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f11fee1-a64a-42cc-9871-756cae72693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f11fee1-a64a-42cc-9871-756cae72693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1102535609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c261befb-446b-4454-b855-1377a29cafd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0223cadaadc457ea8b022a329b2eb80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:14Z,use_quota=True,user_id='f230c9bcaf564b1da478c53da625aa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031e6f12-9a9e-4ac0-9b5f-32bcf8479230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031e6f12-9a9e-4ac0-9b5f-32bcf8479230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969de036-2eaf-4101-bfe0-21e653fe7e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969de036-2eaf-4101-bfe0-21e653fe7e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c261befb-446b-4454-b855-1377a29cafd0', 'volume_name': 'volume-c261befb-446b-4454-b855-1377a29cafd0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a666870-8c4c-463a-9246-c54f760012ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a666870-8c4c-463a-9246-c54f760012ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599449b0-0b75-477e-86a9-9a376ab26825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:14 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Volume c261befb-446b-4454-b855-1377a29cafd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c261befb-446b-4454-b855-1377a29cafd0', 'volume_size': 1}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1102535609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c261befb-446b-4454-b855-1377a29cafd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0223cadaadc457ea8b022a329b2eb80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:14Z,use_quota=True,user_id='f230c9bcaf564b1da478c53da625aa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Creating volume c261befb-446b-4454-b855-1377a29cafd0 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:14 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:14 devstack cinder-volume[83885]: WARNING cinder.quota [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-526905197 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-526905197, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:38:14 devstack cinder-volume[83885]: WARNING cinder.quota [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-526905197 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-526905197, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:38:14 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:14 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0 1073741824
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['8a9c2ab6-52c1-4a9c-8911-cae5217786f5', 'bf4adcca-e141-47a9-b665-c27d8a109793', '05b4d023-394f-4daf-989e-36aef52df30e', '7ad489cd-5543-4bb8-8192-07155ee30af4'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:14 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2" returned: 0 in 0.944s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:14 devstack sudo[89157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2
Apr 29 08:38:14 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:14 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-78ee396f-33e5-4d9d-a3cb-2e6c7726128c tempest-GroupSnapshotsTest-2121115982 None] group_snapshot b4c936fa-2666-47fe-9d0e-9dab7f914391: deleted successfully
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "cinder-quobyte-2146e920-3541-418a-9a00-8c547f77cedb" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-2146e920-3541-418a-9a00-8c547f77cedb" acquired by "delete_volume" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcc7283-0e24-40d0-b3b2-119a9e0353d1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:14 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2" returned: 0 in 0.897s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Lock "cinder-quobyte-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2" released by "delete_volume" :: held 1.898s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Created reservations ['33996c8a-e959-44dc-b76a-a305ee5c12eb', 'c05e0686-9a6e-4a6e-b184-afcad8b1ae7b', '9de21050-272b-494f-83fa-f8c0b50827cb', '6dd17f8e-b5de-4b13-8620-68cfcd06a22f'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:15 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb
Apr 29 08:38:15 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:15 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0 1073741824" returned: 0 in 1.120s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:15 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:15 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:15 devstack sudo[89168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0
Apr 29 08:38:15 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:15 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb" returned: 0 in 0.938s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:15 devstack sudo[89175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb
Apr 29 08:38:15 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:16 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.916s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:16 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Deleted volume successfully.
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f2754d8c-e421-4cc0-952f-2bd45371819c tempest-VolumesActionsTest-1109330196 None] Lock "cinder-ba82bd3c-20a4-4ddf-af0a-b4b3255b9db2-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:16 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0" returned: 0 in 0.946s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599449b0-0b75-477e-86a9-9a376ab26825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c261befb-446b-4454-b855-1377a29cafd0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b9c8b6-5de4-4c0c-97cc-cc9d06c8960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (a91a72fd-6dfa-41bf-95e2-a79f392b4509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ed3dfa-6159-4c78-bcc1-22ea7eb882cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:16 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Volume volume-c261befb-446b-4454-b855-1377a29cafd0 (c261befb-446b-4454-b855-1377a29cafd0): created successfully
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b9c8b6-5de4-4c0c-97cc-cc9d06c8960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Flow 'volume_create_manager' (4eefff70-d95c-4cd7-b57e-852f8ea5ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ed3dfa-6159-4c78-bcc1-22ea7eb882cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683842363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dada1c03-8f45-403b-84cb-50e5267e03c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:16Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d8e8f0-eac2-4342-a34f-f22198d87ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d8e8f0-eac2-4342-a34f-f22198d87ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f1ea39-968b-45b5-9352-c049bc106f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f1ea39-968b-45b5-9352-c049bc106f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dada1c03-8f45-403b-84cb-50e5267e03c7', 'volume_name': 'volume-dada1c03-8f45-403b-84cb-50e5267e03c7', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4f405c-dc81-41b6-8a60-e85521d26a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4f405c-dc81-41b6-8a60-e85521d26a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a09722-6b1c-493c-857d-888da12a4f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:16 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Volume dada1c03-8f45-403b-84cb-50e5267e03c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dada1c03-8f45-403b-84cb-50e5267e03c7', 'volume_size': 1}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683842363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dada1c03-8f45-403b-84cb-50e5267e03c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:16Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Creating volume dada1c03-8f45-403b-84cb-50e5267e03c7 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:16 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:16 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a5c45eca-e8f5-4f22-b75c-2a99a7bf32c5 tempest-VolumesTransfersV355Test-1599568075 None] Created volume successfully.
Apr 29 08:38:16 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7 1073741824
Apr 29 08:38:16 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:16 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2146e920-3541-418a-9a00-8c547f77cedb" returned: 0 in 0.897s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Lock "cinder-quobyte-2146e920-3541-418a-9a00-8c547f77cedb" released by "delete_volume" :: held 1.921s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['af3ec5c6-4a86-494b-a419-6b814be3aca6'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:16 devstack cinder-volume[83885]: WARNING cinder.quota [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-526905197 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-526905197, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:38:16 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Created reservations ['929d2b8a-e78f-4a16-b6b5-3e236cc1a0b7', '3aa01796-e9fc-4a1f-a0c3-faa7e7618272', 'ec36f36c-8e3b-43d4-b966-8deefecac18b', '7e9bebaa-ca2f-4cb6-95be-75e22ff8f7cf'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:17 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:17 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:17 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7 1073741824" returned: 0 in 1.152s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:17 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=134,cinder:UPDATE=122,cinder:DELETE=7,cinder:INSERT=39 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:38:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:17 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7
Apr 29 08:38:17 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:18 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.948s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:18 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-cf367635-b9eb-4b5d-9038-3175af435dc2 tempest-GroupSnapshotsTest-2121115982 None] Delete group completed successfully.
Apr 29 08:38:18 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7" returned: 0 in 0.769s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a09722-6b1c-493c-857d-888da12a4f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dada1c03-8f45-403b-84cb-50e5267e03c7', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f919e9-c7f5-416d-b99d-d8f7b6a150c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:18 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Volume volume-dada1c03-8f45-403b-84cb-50e5267e03c7 (dada1c03-8f45-403b-84cb-50e5267e03c7): created successfully
Apr 29 08:38:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f919e9-c7f5-416d-b99d-d8f7b6a150c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (a91a72fd-6dfa-41bf-95e2-a79f392b4509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-26bb654c-c66f-4cf4-aa72-cf886e263fbe tempest-VolumesActionsTest-471946475 None] Created volume successfully.
Apr 29 08:38:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-de3817bf-b24a-450a-842a-09243663023f tempest-VolumesTransfersV355Test-503306405 None] Transfer volume completed successfully.
Apr 29 08:38:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Acquiring lock "cinder-dada1c03-8f45-403b-84cb-50e5267e03c7-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Lock "cinder-dada1c03-8f45-403b-84cb-50e5267e03c7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Acquiring lock "cinder-quobyte-dada1c03-8f45-403b-84cb-50e5267e03c7" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Lock "cinder-quobyte-dada1c03-8f45-403b-84cb-50e5267e03c7" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:19 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa819e2e-d40e-49e7-8126-665e1b7446c1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Acquiring lock "cinder-c261befb-446b-4454-b855-1377a29cafd0-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:20 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7
Apr 29 08:38:20 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Lock "cinder-c261befb-446b-4454-b855-1377a29cafd0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Acquiring lock "cinder-quobyte-c261befb-446b-4454-b855-1377a29cafd0" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Lock "cinder-quobyte-c261befb-446b-4454-b855-1377a29cafd0" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[1670db2e-bfed-4476-82fe-3936047fd398]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:20 devstack sudo[89229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0
Apr 29 08:38:20 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Flow 'volume_create_manager' (89f8656e-bca5-41fe-8385-a6e1c16ecdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fa0476-de0d-4743-99ee-d340d68df2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fa0476-de0d-4743-99ee-d340d68df2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-345349964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951c2834-9ea8-442f-a587-c60e70a2f4f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03e24b7ef3584d0694faef519cc37e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:21Z,use_quota=True,user_id='ae085d9c0b4f46378053648ab4cc44d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be92100b-b4b2-497d-a086-7d5a258f2902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be92100b-b4b2-497d-a086-7d5a258f2902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6f171e-34e9-4200-9481-42722eb561ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6f171e-34e9-4200-9481-42722eb561ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '951c2834-9ea8-442f-a587-c60e70a2f4f2', 'volume_name': 'volume-951c2834-9ea8-442f-a587-c60e70a2f4f2', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70c59f9-c9ad-477c-922e-74d12864edf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70c59f9-c9ad-477c-922e-74d12864edf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1563f35e-ce6a-4a4a-9328-bab1284e3f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:20 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Volume 951c2834-9ea8-442f-a587-c60e70a2f4f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-951c2834-9ea8-442f-a587-c60e70a2f4f2', 'volume_size': 1}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-345349964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951c2834-9ea8-442f-a587-c60e70a2f4f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03e24b7ef3584d0694faef519cc37e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:21Z,use_quota=True,user_id='ae085d9c0b4f46378053648ab4cc44d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Creating volume 951c2834-9ea8-442f-a587-c60e70a2f4f2 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:20 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:20 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2 1073741824
Apr 29 08:38:20 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:20 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7" returned: 0 in 1.158s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:21 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7
Apr 29 08:38:21 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:21 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0" returned: 0 in 0.916s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:21 devstack sudo[89241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0
Apr 29 08:38:21 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:21 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dada1c03-8f45-403b-84cb-50e5267e03c7" returned: 0 in 0.796s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Lock "cinder-quobyte-dada1c03-8f45-403b-84cb-50e5267e03c7" released by "delete_volume" :: held 2.020s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:21 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c261befb-446b-4454-b855-1377a29cafd0" returned: 0 in 0.770s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Lock "cinder-quobyte-c261befb-446b-4454-b855-1377a29cafd0" released by "delete_volume" :: held 1.764s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:21 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2 1073741824" returned: 0 in 1.083s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:21 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Created reservations ['6985e615-7d79-47a9-aaa3-0ef4695d13e4', '830902e3-6230-487c-8871-b3c12530b587', '94de8710-8bf5-449b-9094-9dde3b58e2dd', '48ad1854-f9d3-4c57-9923-baba5676dcf0'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:22 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2
Apr 29 08:38:22 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Created reservations ['9302a6ee-1116-4773-8579-91bd9fe3a1ad', '7afed290-a96d-4eba-a3ef-9eee9f74990e', '49932803-eec6-4b32-baff-3f714bf939a4', 'a513b4cb-eaae-4870-bae3-dbccf092213f'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:22 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:22 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:22 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:22 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:22 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2" returned: 0 in 0.880s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1563f35e-ce6a-4a4a-9328-bab1284e3f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951c2834-9ea8-442f-a587-c60e70a2f4f2', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07986d18-ff64-4a69-b376-62439838a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:22 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Volume volume-951c2834-9ea8-442f-a587-c60e70a2f4f2 (951c2834-9ea8-442f-a587-c60e70a2f4f2): created successfully
Apr 29 08:38:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07986d18-ff64-4a69-b376-62439838a79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Flow 'volume_create_manager' (89f8656e-bca5-41fe-8385-a6e1c16ecdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:23 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5173da02-32a1-4bdc-b08e-1068cb85a180 tempest-VolumesTestJSON-812654510 None] Created volume successfully.
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (3dfbd382-b96c-4024-8176-97d212997cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52ab9a4-330f-4508-82e6-cc59a3674f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52ab9a4-330f-4508-82e6-cc59a3674f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-714429977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27e3e45-a3cd-4d52-a1ec-fee805c3064b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:23Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:23 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f9990d-378c-478e-9cf9-95e1b7003745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f9990d-378c-478e-9cf9-95e1b7003745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e545b54c-fd53-4f26-a778-6423a910ef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e545b54c-fd53-4f26-a778-6423a910ef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27e3e45-a3cd-4d52-a1ec-fee805c3064b', 'volume_name': 'volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4fae38-cb8e-4de3-be39-c5167d81b7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4fae38-cb8e-4de3-be39-c5167d81b7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f0bd8b-ff59-4329-9f11-20d5b90bc227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Volume b27e3e45-a3cd-4d52-a1ec-fee805c3064b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b', 'volume_size': 1}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-714429977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27e3e45-a3cd-4d52-a1ec-fee805c3064b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:23Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Creating volume b27e3e45-a3cd-4d52-a1ec-fee805c3064b {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:23 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:23 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.202s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.118s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:23 devstack sudo[89259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b 1073741824
Apr 29 08:38:23 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:23 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Deleted volume successfully.
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c5fb6f35-84bc-4e2a-9cff-463cf11f5308 tempest-VolumesActionsTest-1109330196 None] Lock "cinder-dada1c03-8f45-403b-84cb-50e5267e03c7-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:23 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Deleted volume successfully.
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea5d1178-b016-47a6-8d06-880935672ce7 tempest-VolumesTransfersV355Test-488587642 None] Lock "cinder-c261befb-446b-4454-b855-1377a29cafd0-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Flow 'volume_create_manager' (1002e02a-8710-4fcc-95ed-321c1bda4794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d99d11-06a7-4cb9-9286-6f3dc3fd5f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=131,cinder:UPDATE=168,cinder:INSERT=41,cinder:DELETE=8 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d99d11-06a7-4cb9-9286-6f3dc3fd5f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-501200884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42538f8b-4e60-4381-90fd-ac337de7597a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0223cadaadc457ea8b022a329b2eb80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:23Z,use_quota=True,user_id='f230c9bcaf564b1da478c53da625aa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a6e7a8-8939-49b9-b1f7-e5f0ebf4ed74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a6e7a8-8939-49b9-b1f7-e5f0ebf4ed74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf02b4d-3d7b-491e-88d6-07bdef191df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf02b4d-3d7b-491e-88d6-07bdef191df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42538f8b-4e60-4381-90fd-ac337de7597a', 'volume_name': 'volume-42538f8b-4e60-4381-90fd-ac337de7597a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dd2c03-de3c-4589-aa8c-d32e77b1ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dd2c03-de3c-4589-aa8c-d32e77b1ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d927d0-f407-4218-a102-a19568783e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:23 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Volume 42538f8b-4e60-4381-90fd-ac337de7597a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42538f8b-4e60-4381-90fd-ac337de7597a', 'volume_size': 1}
Apr 29 08:38:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:24 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b 1073741824" returned: 0 in 0.930s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:24 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b
Apr 29 08:38:24 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Flow 'volume_create_manager' (d8c1fe87-4b87-4271-a3c1-fa300208700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641d4eba-7bb3-4877-a9c0-9df4a801d4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641d4eba-7bb3-4877-a9c0-9df4a801d4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1227764796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deb55dc-5c55-4b92-a25c-74494833d337,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03e24b7ef3584d0694faef519cc37e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:25Z,use_quota=True,user_id='ae085d9c0b4f46378053648ab4cc44d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd4690b-4156-4cfd-9cf2-e2f8cbd968ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd4690b-4156-4cfd-9cf2-e2f8cbd968ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0716f797-94da-4b44-a3c3-20d18a8c24a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0716f797-94da-4b44-a3c3-20d18a8c24a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0deb55dc-5c55-4b92-a25c-74494833d337', 'volume_name': 'volume-0deb55dc-5c55-4b92-a25c-74494833d337', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d84404-a828-42fe-8e23-77a3ab0c79ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d84404-a828-42fe-8e23-77a3ab0c79ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764504cc-1774-4862-a9a5-4a6c185d2e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:24 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Volume 0deb55dc-5c55-4b92-a25c-74494833d337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0deb55dc-5c55-4b92-a25c-74494833d337', 'volume_size': 1}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:24 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b" returned: 0 in 0.713s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-501200884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42538f8b-4e60-4381-90fd-ac337de7597a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0223cadaadc457ea8b022a329b2eb80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:23Z,use_quota=True,user_id='f230c9bcaf564b1da478c53da625aa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Creating volume 42538f8b-4e60-4381-90fd-ac337de7597a {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:24 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:24 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a 1073741824
Apr 29 08:38:24 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f0bd8b-ff59-4329-9f11-20d5b90bc227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba707dd-9317-47b0-9d51-755161fb5f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:25 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Volume volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b (b27e3e45-a3cd-4d52-a1ec-fee805c3064b): created successfully
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba707dd-9317-47b0-9d51-755161fb5f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (3dfbd382-b96c-4024-8176-97d212997cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:25 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-bbbab41c-3858-4f42-981a-8ff6e767058d tempest-VolumesActionsTest-471946475 None] Created volume successfully.
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Acquiring lock "cinder-b27e3e45-a3cd-4d52-a1ec-fee805c3064b-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Lock "cinder-b27e3e45-a3cd-4d52-a1ec-fee805c3064b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Acquiring lock "cinder-quobyte-b27e3e45-a3cd-4d52-a1ec-fee805c3064b" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Lock "cinder-quobyte-b27e3e45-a3cd-4d52-a1ec-fee805c3064b" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff88bb07-a772-4102-8460-ace6beb1145d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:25 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b
Apr 29 08:38:25 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:25 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a 1073741824" returned: 0 in 0.931s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:25 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a
Apr 29 08:38:25 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:26 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b" returned: 0 in 0.842s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:26 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b
Apr 29 08:38:26 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:26 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a" returned: 0 in 0.642s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1227764796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deb55dc-5c55-4b92-a25c-74494833d337,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03e24b7ef3584d0694faef519cc37e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:25Z,use_quota=True,user_id='ae085d9c0b4f46378053648ab4cc44d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Creating volume 0deb55dc-5c55-4b92-a25c-74494833d337 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:26 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:26 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337 1073741824
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d927d0-f407-4218-a102-a19568783e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42538f8b-4e60-4381-90fd-ac337de7597a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:26 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a47ced-c744-46c1-ab72-07c2619ff894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:26 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Volume volume-42538f8b-4e60-4381-90fd-ac337de7597a (42538f8b-4e60-4381-90fd-ac337de7597a): created successfully
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a47ced-c744-46c1-ab72-07c2619ff894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Flow 'volume_create_manager' (1002e02a-8710-4fcc-95ed-321c1bda4794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:26 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e8b0f08e-48c5-44c5-8f5d-1a39245853b9 tempest-VolumesTransfersV355Test-1599568075 None] Created volume successfully.
Apr 29 08:38:27 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b27e3e45-a3cd-4d52-a1ec-fee805c3064b" returned: 0 in 0.729s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Lock "cinder-quobyte-b27e3e45-a3cd-4d52-a1ec-fee805c3064b" released by "delete_volume" :: held 1.630s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Created reservations ['a2bbd164-97ec-467a-86ae-045a30383724', '50147aef-50f4-4888-a129-13876d0b0ccc', '66fd6268-d80a-488f-9465-a8dc324bf5e1', '0c46c8dc-6151-404c-85ce-d9ed3efab108'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:27 devstack sudo[89293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:27 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:27 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337 1073741824" returned: 0 in 1.017s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:27 devstack sudo[89295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337
Apr 29 08:38:27 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:28 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.837s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:28 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Deleted volume successfully.
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be00aa4-ef7e-4365-9886-4409b3a3b84f tempest-VolumesActionsTest-1109330196 None] Lock "cinder-b27e3e45-a3cd-4d52-a1ec-fee805c3064b-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Acquiring lock "cinder-42538f8b-4e60-4381-90fd-ac337de7597a-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Lock "cinder-42538f8b-4e60-4381-90fd-ac337de7597a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Acquiring lock "cinder-quobyte-42538f8b-4e60-4381-90fd-ac337de7597a" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Lock "cinder-quobyte-42538f8b-4e60-4381-90fd-ac337de7597a" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:28 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337" returned: 0 in 0.926s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[56507a3e-4c5b-4f62-838a-2006a2203f6a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764504cc-1774-4862-a9a5-4a6c185d2e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0deb55dc-5c55-4b92-a25c-74494833d337', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d19d8a3-b928-4827-8423-c1d2df3f2d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:28 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Volume volume-0deb55dc-5c55-4b92-a25c-74494833d337 (0deb55dc-5c55-4b92-a25c-74494833d337): created successfully
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d19d8a3-b928-4827-8423-c1d2df3f2d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Flow 'volume_create_manager' (d8c1fe87-4b87-4271-a3c1-fa300208700e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (8a744abb-1db3-4c75-84a6-4d0048ec3bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c62e76-f33f-45e9-879b-db2ea120c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:28 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-91f0b9ba-e0ec-42f1-b1da-127c1ffad76e tempest-VolumesTestJSON-812654510 None] Created volume successfully.
Apr 29 08:38:28 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c62e76-f33f-45e9-879b-db2ea120c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698159498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:29Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:28 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670748c2-21fb-4ab1-8b4b-520d05d3d162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670748c2-21fb-4ab1-8b4b-520d05d3d162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3def76e8-14a8-426c-b8aa-0405e871f44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3def76e8-14a8-426c-b8aa-0405e871f44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca', 'volume_name': 'volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd4a26b-95bc-49df-950f-245fb0e83a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd4a26b-95bc-49df-950f-245fb0e83a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7b9c15-f705-4379-9762-4561c3af6978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:28 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Volume fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca', 'volume_size': 1}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698159498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:29Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Creating volume fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:28 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:28 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca 1073741824
Apr 29 08:38:28 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:29 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a" returned: 0 in 0.826s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:29 devstack sudo[89310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a
Apr 29 08:38:29 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:29 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca 1073741824" returned: 0 in 1.021s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:29 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca
Apr 29 08:38:29 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:29 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Flow 'volume_create_manager' (5e20d29b-921f-4a0b-b906-d92442aab4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07b3640-ef60-4941-91de-c9cd6dfba379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07b3640-ef60-4941-91de-c9cd6dfba379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1184331486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641176e7-b9e3-458b-bfb6-a796f5f04aea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03e24b7ef3584d0694faef519cc37e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:30Z,use_quota=True,user_id='ae085d9c0b4f46378053648ab4cc44d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44361ba5-26e4-4c78-be57-57f70a18015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44361ba5-26e4-4c78-be57-57f70a18015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53bb570-71df-47d2-94a7-c10c6b43c049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53bb570-71df-47d2-94a7-c10c6b43c049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641176e7-b9e3-458b-bfb6-a796f5f04aea', 'volume_name': 'volume-641176e7-b9e3-458b-bfb6-a796f5f04aea', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34087fb3-db32-45e8-b8d9-ffd0fa17203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34087fb3-db32-45e8-b8d9-ffd0fa17203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cfce02-950b-4cfd-8571-22a90a9a7d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:30 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Volume 641176e7-b9e3-458b-bfb6-a796f5f04aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641176e7-b9e3-458b-bfb6-a796f5f04aea', 'volume_size': 1}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:30 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-42538f8b-4e60-4381-90fd-ac337de7597a" returned: 0 in 0.776s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Lock "cinder-quobyte-42538f8b-4e60-4381-90fd-ac337de7597a" released by "delete_volume" :: held 1.671s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Created reservations ['8b663757-b2f8-459c-84ad-3b3f6bc7e46a', '479700b5-9259-47d9-8bea-9d451a1b95e0', '6bec19fa-30e1-41a2-942f-0b25435264aa', '46e9d705-2d35-4ce5-8a53-30a36f792d0d'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:30 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:30 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:30 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca" returned: 0 in 0.742s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1184331486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641176e7-b9e3-458b-bfb6-a796f5f04aea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03e24b7ef3584d0694faef519cc37e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:30Z,use_quota=True,user_id='ae085d9c0b4f46378053648ab4cc44d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Creating volume 641176e7-b9e3-458b-bfb6-a796f5f04aea {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:30 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:30 devstack sudo[89318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea 1073741824
Apr 29 08:38:30 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7b9c15-f705-4379-9762-4561c3af6978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6915f329-df0e-4d82-97be-352345062e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:30 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Volume volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca (fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca): created successfully
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6915f329-df0e-4d82-97be-352345062e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (8a744abb-1db3-4c75-84a6-4d0048ec3bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:30 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-f74c26aa-e837-4a4a-acdb-c347cf549792 tempest-VolumesActionsTest-471946475 None] Created volume successfully.
Apr 29 08:38:31 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.758s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:31 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:31 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Deleted volume successfully.
Apr 29 08:38:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-120cb4a3-d29a-4cbb-9bc5-da42270e21a2 tempest-VolumesTransfersV355Test-488587642 None] Lock "cinder-42538f8b-4e60-4381-90fd-ac337de7597a-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:31 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea 1073741824" returned: 0 in 1.118s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:31 devstack sudo[89331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea
Apr 29 08:38:31 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Acquiring lock "cinder-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Lock "cinder-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Acquiring lock "cinder-quobyte-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Lock "cinder-quobyte-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd231eb-e7e8-4e72-bfc7-48771cf2a011]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:32 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca
Apr 29 08:38:32 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:32 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea" returned: 0 in 0.833s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cfce02-950b-4cfd-8571-22a90a9a7d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641176e7-b9e3-458b-bfb6-a796f5f04aea', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52282828-32ea-456f-b822-b48391f854c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:32 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Volume volume-641176e7-b9e3-458b-bfb6-a796f5f04aea (641176e7-b9e3-458b-bfb6-a796f5f04aea): created successfully
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52282828-32ea-456f-b822-b48391f854c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Flow 'volume_create_manager' (5e20d29b-921f-4a0b-b906-d92442aab4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:32 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-8895de44-714d-4fc5-8fe3-63aefc924852 tempest-VolumesTestJSON-812654510 None] Created volume successfully.
Apr 29 08:38:33 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca" returned: 0 in 1.029s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:33 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca
Apr 29 08:38:33 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:34 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca" returned: 0 in 0.897s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Lock "cinder-quobyte-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca" released by "delete_volume" :: held 2.001s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Created reservations ['e60ef8e9-21fb-494c-b609-23961044c666', '89dfbd3d-154a-4c24-9cbf-f5efb782db13', 'dfa9cd71-2131-4aba-8c13-51c0eeba6d18', '236d8a8c-19f1-4e5d-be4d-b42f68252377'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:34 devstack sudo[89343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:34 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Acquiring lock "cinder-641176e7-b9e3-458b-bfb6-a796f5f04aea-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Lock "cinder-641176e7-b9e3-458b-bfb6-a796f5f04aea-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Acquiring lock "cinder-quobyte-641176e7-b9e3-458b-bfb6-a796f5f04aea" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Lock "cinder-quobyte-641176e7-b9e3-458b-bfb6-a796f5f04aea" acquired by "delete_volume" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc6687b-5851-43f2-9585-ff97835fa63b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:35 devstack sudo[89345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea
Apr 29 08:38:35 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (06d82c38-1a5a-4aea-9fbe-d0eb0ea4958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8badd4af-c36a-42a5-a636-5ad7f348b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8badd4af-c36a-42a5-a636-5ad7f348b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-807108177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52951268-e60f-4bb4-af8c-249a5a5e4922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:35Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:35 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e99b996-aa13-42bd-9580-d5f91ea5c627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e99b996-aa13-42bd-9580-d5f91ea5c627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a8d6aa-34aa-472e-b8ce-68896e7263e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a8d6aa-34aa-472e-b8ce-68896e7263e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52951268-e60f-4bb4-af8c-249a5a5e4922', 'volume_name': 'volume-52951268-e60f-4bb4-af8c-249a5a5e4922', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ea4a1d-6e5b-4611-96bd-9cc04be39345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ea4a1d-6e5b-4611-96bd-9cc04be39345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626c0c71-c0e4-4f6e-9b2b-d42b55a4b7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:35 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Volume 52951268-e60f-4bb4-af8c-249a5a5e4922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52951268-e60f-4bb4-af8c-249a5a5e4922', 'volume_size': 1}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-807108177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52951268-e60f-4bb4-af8c-249a5a5e4922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce7045a4356421990787ad3c65c97f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:35Z,use_quota=True,user_id='bd8ff6340c0b401da5fc88b1a0e69d10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Creating volume 52951268-e60f-4bb4-af8c-249a5a5e4922 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:35 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.143s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:35 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Deleted volume successfully.
Apr 29 08:38:35 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922 1073741824
Apr 29 08:38:35 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-cc3fcf0e-e300-479b-b387-2450a6baa70b tempest-VolumesActionsTest-1109330196 None] Lock "cinder-fa5cf3a5-6abb-47d9-bedc-e6d6f523f6ca-delete_volume" released by "delete_volume" :: held 3.497s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:35 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea" returned: 0 in 1.083s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:35 devstack sudo[89354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea
Apr 29 08:38:35 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:36 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922 1073741824" returned: 0 in 1.067s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:36 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-641176e7-b9e3-458b-bfb6-a796f5f04aea" returned: 0 in 0.817s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:36 devstack sudo[89361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922
Apr 29 08:38:36 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Lock "cinder-quobyte-641176e7-b9e3-458b-bfb6-a796f5f04aea" released by "delete_volume" :: held 1.980s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:36 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Created reservations ['a540c39c-9426-4b8c-9e80-9874268e58b6', '3d53687a-f12b-49b8-9fed-5e3d9da440dd', '94f556d9-94a3-4043-a429-baa2fb9bd26d', 'fb817f91-59f9-448a-9537-b15fd9bccce7'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:37 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:37 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Acquiring lock "cinder-0deb55dc-5c55-4b92-a25c-74494833d337-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Lock "cinder-0deb55dc-5c55-4b92-a25c-74494833d337-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Acquiring lock "cinder-quobyte-0deb55dc-5c55-4b92-a25c-74494833d337" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Lock "cinder-quobyte-0deb55dc-5c55-4b92-a25c-74494833d337" acquired by "delete_volume" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f6d7e3-988b-4c94-9661-385640e43741]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:37 devstack sudo[89365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337
Apr 29 08:38:37 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:37 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922" returned: 0 in 0.980s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626c0c71-c0e4-4f6e-9b2b-d42b55a4b7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52951268-e60f-4bb4-af8c-249a5a5e4922', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b24a31-d6e9-4b57-8418-c42a96b6156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:37 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Volume volume-52951268-e60f-4bb4-af8c-249a5a5e4922 (52951268-e60f-4bb4-af8c-249a5a5e4922): created successfully
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b24a31-d6e9-4b57-8418-c42a96b6156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Flow 'volume_create_manager' (06d82c38-1a5a-4aea-9fbe-d0eb0ea4958c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:37 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-267d852f-0dd7-45d5-bab8-ebb4feb0d1c9 tempest-VolumesActionsTest-471946475 None] Created volume successfully.
Apr 29 08:38:37 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.941s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:37 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:37 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Deleted volume successfully.
Apr 29 08:38:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08edcc71-38d7-465b-be90-99c13029f988 tempest-VolumesTestJSON-812654510 None] Lock "cinder-641176e7-b9e3-458b-bfb6-a796f5f04aea-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:38 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337" returned: 0 in 0.940s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:38 devstack sudo[89372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337
Apr 29 08:38:38 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:38 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0deb55dc-5c55-4b92-a25c-74494833d337" returned: 0 in 0.762s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Lock "cinder-quobyte-0deb55dc-5c55-4b92-a25c-74494833d337" released by "delete_volume" :: held 1.758s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Created reservations ['5be02e83-5fcf-4f43-b20a-761f108b8a35', 'af80acc5-93e3-462b-960b-300bda0e8625', '3b8393f2-532e-4593-a64a-86dbd6734654', 'df86f58f-2e7c-4e81-82a2-97511abf242f'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:39 devstack sudo[89377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:39 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Acquiring lock "cinder-52951268-e60f-4bb4-af8c-249a5a5e4922-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Lock "cinder-52951268-e60f-4bb4-af8c-249a5a5e4922-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Acquiring lock "cinder-951c2834-9ea8-442f-a587-c60e70a2f4f2-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Acquiring lock "cinder-quobyte-52951268-e60f-4bb4-af8c-249a5a5e4922" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Lock "cinder-951c2834-9ea8-442f-a587-c60e70a2f4f2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Lock "cinder-quobyte-52951268-e60f-4bb4-af8c-249a5a5e4922" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[77de614f-56a5-40e7-b461-8c25daf2f530]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Acquiring lock "cinder-quobyte-951c2834-9ea8-442f-a587-c60e70a2f4f2" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Lock "cinder-quobyte-951c2834-9ea8-442f-a587-c60e70a2f4f2" acquired by "delete_volume" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[292c68b6-b3ef-48ab-877e-829967469e45]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:39 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922
Apr 29 08:38:39 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:39 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2
Apr 29 08:38:39 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:40 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.939s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:40 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Deleted volume successfully.
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7d2b20e1-5c82-455d-a59a-18b3e0ea83ee tempest-VolumesTestJSON-812654510 None] Lock "cinder-0deb55dc-5c55-4b92-a25c-74494833d337-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Flow 'volume_create_manager' (b0ce6145-b07c-4136-890e-7b21a2f87c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ace44e-d25b-4a65-b438-c70eb227ad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ace44e-d25b-4a65-b438-c70eb227ad9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1850351814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6583f33f-49d1-4ba9-a552-96a5d30f2078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e76b1cd70640a8a0a8ad4bf0a068b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:40Z,use_quota=True,user_id='af7d3fab9bb64515a01e5c68cc1e9f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02be31b1-4acf-4b21-9496-1266ee83b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02be31b1-4acf-4b21-9496-1266ee83b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6c8cfd-b5e3-4e99-9869-729c52bdc968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6c8cfd-b5e3-4e99-9869-729c52bdc968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6583f33f-49d1-4ba9-a552-96a5d30f2078', 'volume_name': 'volume-6583f33f-49d1-4ba9-a552-96a5d30f2078', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0231845f-1fe9-4f9d-9158-edd0a4297b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0231845f-1fe9-4f9d-9158-edd0a4297b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c210bf8-1504-45ad-a3d5-ef1216f69715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:40 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Volume 6583f33f-49d1-4ba9-a552-96a5d30f2078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6583f33f-49d1-4ba9-a552-96a5d30f2078', 'volume_size': 1}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1850351814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6583f33f-49d1-4ba9-a552-96a5d30f2078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e76b1cd70640a8a0a8ad4bf0a068b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:40Z,use_quota=True,user_id='af7d3fab9bb64515a01e5c68cc1e9f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Creating volume 6583f33f-49d1-4ba9-a552-96a5d30f2078 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:40 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:40 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078 1073741824
Apr 29 08:38:40 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:40 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922" returned: 0 in 0.989s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:40 devstack sudo[89393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922
Apr 29 08:38:40 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:40 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2" returned: 0 in 1.014s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:40 devstack sudo[89395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2
Apr 29 08:38:40 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:41 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-52951268-e60f-4bb4-af8c-249a5a5e4922" returned: 0 in 0.692s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Lock "cinder-quobyte-52951268-e60f-4bb4-af8c-249a5a5e4922" released by "delete_volume" :: held 1.738s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Created reservations ['a2c6f475-83ae-4875-9cc6-dba1b9d18081', '76645a65-1477-4c3d-9bcd-ec58d252babe', 'dd39d27b-e208-4209-a97a-e2f35966048c', '79cad363-80a6-4ac5-9506-b4320433fca6'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:41 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-951c2834-9ea8-442f-a587-c60e70a2f4f2" returned: 0 in 0.737s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Lock "cinder-quobyte-951c2834-9ea8-442f-a587-c60e70a2f4f2" released by "delete_volume" :: held 1.833s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:41 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:41 devstack sudo[89403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078 1073741824" returned: 0 in 1.016s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:41 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Created reservations ['7141ed3c-6fba-4464-85be-a2d56ca49fca', '84fd5da0-4b73-451f-9ec3-e603be077a54', 'a8c76914-c168-4fc2-b1a2-7e4b3379d029', '3a2554ec-aaee-4e85-9b23-8ccdfc4989ee'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:41 devstack sudo[89405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078
Apr 29 08:38:41 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:41 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:41 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:41 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Flow 'volume_create_manager' (d39ccc49-9f86-4648-82a2-393c1e0871e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991ef203-a5a8-4834-82ec-32480c253fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991ef203-a5a8-4834-82ec-32480c253fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-886278054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09785077-1171-4a80-9a61-503073ab9cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6745040dbd454d24b9bc8d63f49c4d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:42Z,use_quota=True,user_id='37f85068267540e99238c77eed65a85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22c55de-ff45-4c17-9b98-4e7f5f08ec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22c55de-ff45-4c17-9b98-4e7f5f08ec65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbec6b1-4202-47e8-a785-78b780d8d4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbec6b1-4202-47e8-a785-78b780d8d4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09785077-1171-4a80-9a61-503073ab9cb1', 'volume_name': 'volume-09785077-1171-4a80-9a61-503073ab9cb1', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e87f68-a222-49db-8a3b-48e193f0234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e87f68-a222-49db-8a3b-48e193f0234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2de061-2412-454d-b5bc-689dfb125e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:42 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Volume 09785077-1171-4a80-9a61-503073ab9cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09785077-1171-4a80-9a61-503073ab9cb1', 'volume_size': 1}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:42 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.810s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Deleted volume successfully.
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b52c2e54-08a0-4298-9cd2-1a75c461f665 tempest-VolumesActionsTest-471946475 None] Lock "cinder-52951268-e60f-4bb4-af8c-249a5a5e4922-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:42 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078" returned: 0 in 0.936s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.409s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-886278054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09785077-1171-4a80-9a61-503073ab9cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6745040dbd454d24b9bc8d63f49c4d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:42Z,use_quota=True,user_id='37f85068267540e99238c77eed65a85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Creating volume 09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:42 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:42 devstack sudo[89412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1 1073741824
Apr 29 08:38:42 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c210bf8-1504-45ad-a3d5-ef1216f69715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6583f33f-49d1-4ba9-a552-96a5d30f2078', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1821caaa-6f39-49a8-b8a1-b6633aeb5f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:42 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.895s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:42 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Volume volume-6583f33f-49d1-4ba9-a552-96a5d30f2078 (6583f33f-49d1-4ba9-a552-96a5d30f2078): created successfully
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1821caaa-6f39-49a8-b8a1-b6633aeb5f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Flow 'volume_create_manager' (b0ce6145-b07c-4136-890e-7b21a2f87c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Deleted volume successfully.
Apr 29 08:38:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-11de7136-9227-44db-8a31-f3febbc68fd7 tempest-VolumesTransfersV357Test-610430995 None] Created volume successfully.
Apr 29 08:38:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4c413806-c20a-4888-985f-4f9d568f3759 tempest-VolumesTestJSON-812654510 None] Lock "cinder-951c2834-9ea8-442f-a587-c60e70a2f4f2-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:43 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1 1073741824" returned: 0 in 1.018s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:43 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1
Apr 29 08:38:43 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:44 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1" returned: 0 in 0.813s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2de061-2412-454d-b5bc-689dfb125e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09785077-1171-4a80-9a61-503073ab9cb1', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddc79ae-a641-45db-ad1e-b79043268ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:44 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Volume volume-09785077-1171-4a80-9a61-503073ab9cb1 (09785077-1171-4a80-9a61-503073ab9cb1): created successfully
Apr 29 08:38:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddc79ae-a641-45db-ad1e-b79043268ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Flow 'volume_create_manager' (d39ccc49-9f86-4648-82a2-393c1e0871e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:44 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-880f962b-e4fa-4b05-becf-71b0efcfbb7f tempest-VolumesDeleteCascade-1814472780 None] Created volume successfully.
Apr 29 08:38:44 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-52a75171-5239-478a-a3da-2256f51966e1 tempest-VolumesTransfersV357Test-1160537559 None] Transfer volume completed successfully.
Apr 29 08:38:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Creating offline snapshot 81f47621-7a6a-4382-bcc0-15fd138c1145 of volume 09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:38:45 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6555f3-6fa9-44a1-802d-64b50bda7014]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:45 devstack sudo[89423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1
Apr 29 08:38:45 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Acquiring lock "cinder-6583f33f-49d1-4ba9-a552-96a5d30f2078-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Lock "cinder-6583f33f-49d1-4ba9-a552-96a5d30f2078-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Acquiring lock "cinder-quobyte-6583f33f-49d1-4ba9-a552-96a5d30f2078" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Lock "cinder-quobyte-6583f33f-49d1-4ba9-a552-96a5d30f2078" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:46 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d61b109-bc5f-4939-a5af-c8c9e58dd3b5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:46 devstack sudo[89426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078
Apr 29 08:38:46 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:46 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1" returned: 0 in 1.101s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:46 devstack sudo[89431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 1G
Apr 29 08:38:46 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:47 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078" returned: 0 in 0.875s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:47 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078
Apr 29 08:38:47 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:47 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8db1a40d-2816-46ab-9979-2d62fbffd33a tempest-BackendsCapabilitiesAdminTestsJSON-129777335 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515808105469, 'free_capacity_gb': 1775.6515808105469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83885) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 29 08:38:47 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 1G" returned: 0 in 0.967s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09785077-1171-4a80-9a61-503073ab9cb1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:47 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09785077-1171-4a80-9a61-503073ab9cb1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145
Apr 29 08:38:47 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:47 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6583f33f-49d1-4ba9-a552-96a5d30f2078" returned: 0 in 0.677s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:47 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Lock "cinder-quobyte-6583f33f-49d1-4ba9-a552-96a5d30f2078" released by "delete_volume" :: held 1.639s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:47 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Created reservations ['e791e2a4-b16a-4cfc-bb70-1d8bb8c7bf77', '315957d7-969c-4bf1-b9a6-6e3874413e6b', 'c490b268-de6e-4c73-abe3-79e3d3abd811', '5f33957b-7023-4674-80f0-707a4132dc70'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a373a6d1-0e00-494b-a93f-1149d8d922a6 tempest-BackendsCapabilitiesAdminTestsJSON-129777335 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515808105469, 'free_capacity_gb': 1775.6515808105469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83885) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:48 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:48 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:48 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09785077-1171-4a80-9a61-503073ab9cb1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145" returned: 0 in 0.759s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:48 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 is being set with open permissions: ugo+rw
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:48 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145
Apr 29 08:38:48 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:48 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.715s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:48 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Deleted volume successfully.
Apr 29 08:38:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-eb462470-4230-4d5a-bb6d-e37b6ac6c2f3 tempest-VolumesTransfersV357Test-625235683 None] Lock "cinder-6583f33f-49d1-4ba9-a552-96a5d30f2078-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Flow 'volume_create_manager' (8e018d44-e68c-4557-a813-7c9ac8146f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7fbc9f-4710-40e0-9737-03a0152fd185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7fbc9f-4710-40e0-9737-03a0152fd185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2112574516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4392be3-93db-4388-876d-bac05eec62c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e76b1cd70640a8a0a8ad4bf0a068b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:49Z,use_quota=True,user_id='af7d3fab9bb64515a01e5c68cc1e9f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd423bca-fdb3-4789-821d-e0e0b0174f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd423bca-fdb3-4789-821d-e0e0b0174f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582ed8fb-e7f5-489b-9322-c2f4aaeb129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:49 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582ed8fb-e7f5-489b-9322-c2f4aaeb129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4392be3-93db-4388-876d-bac05eec62c5', 'volume_name': 'volume-c4392be3-93db-4388-876d-bac05eec62c5', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb2c636-f4aa-44fc-b6fd-16a30659ac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb2c636-f4aa-44fc-b6fd-16a30659ac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bc702d-ce9f-4a2e-b23e-830c83d6a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:49 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Volume c4392be3-93db-4388-876d-bac05eec62c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4392be3-93db-4388-876d-bac05eec62c5', 'volume_size': 1}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145" returned: 0 in 0.812s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:49 devstack sudo[89456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.info
Apr 29 08:38:49 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:49 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:49 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:49 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.info" returned: 0 in 0.711s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:49 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.info is being set with open permissions: ugo+rw
Apr 29 08:38:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:50 devstack sudo[89461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.info
Apr 29 08:38:50 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:50 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.854s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:50 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.info" returned: 0 in 0.790s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.273s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.580s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2112574516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4392be3-93db-4388-876d-bac05eec62c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e76b1cd70640a8a0a8ad4bf0a068b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:49Z,use_quota=True,user_id='af7d3fab9bb64515a01e5c68cc1e9f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Creating volume c4392be3-93db-4388-876d-bac05eec62c5 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:50 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:50 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5 1073741824
Apr 29 08:38:50 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:50 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-bb4c58fe-d839-42d1-92e9-2eec02198ec0 tempest-VolumesDeleteCascade-1814472780 None] Create snapshot completed successfully
Apr 29 08:38:51 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5 1073741824" returned: 0 in 1.103s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:52 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5
Apr 29 08:38:52 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:52 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5" returned: 0 in 0.736s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.510s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Creating offline snapshot 5ec95eee-3102-4ea6-a5bf-25eae2064138 of volume 09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bc702d-ce9f-4a2e-b23e-830c83d6a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4392be3-93db-4388-876d-bac05eec62c5', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375ba90f-9a13-4c2e-a108-d4e57cf1bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[943cf87f-1d50-4804-b2a1-bd300a72f784]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:52 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Volume volume-c4392be3-93db-4388-876d-bac05eec62c5 (c4392be3-93db-4388-876d-bac05eec62c5): created successfully
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375ba90f-9a13-4c2e-a108-d4e57cf1bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Flow 'volume_create_manager' (8e018d44-e68c-4557-a813-7c9ac8146f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:52 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-08c304f3-ad39-467f-811a-b6b524c8f93f tempest-VolumesTransfersV357Test-610430995 None] Created volume successfully.
Apr 29 08:38:52 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145
Apr 29 08:38:52 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:53 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145" returned: 0 in 1.003s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09785077-1171-4a80-9a61-503073ab9cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:53 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 1G
Apr 29 08:38:53 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Acquiring lock "cinder-c4392be3-93db-4388-876d-bac05eec62c5-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Lock "cinder-c4392be3-93db-4388-876d-bac05eec62c5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Acquiring lock "cinder-quobyte-c4392be3-93db-4388-876d-bac05eec62c5" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Lock "cinder-quobyte-c4392be3-93db-4388-876d-bac05eec62c5" acquired by "delete_volume" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e310710-2368-4a5f-8b48-47c2281eea75]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:54 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5
Apr 29 08:38:54 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:54 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 1G" returned: 0 in 1.059s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:54 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138
Apr 29 08:38:54 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:55 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5" returned: 0 in 0.865s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:55 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5
Apr 29 08:38:55 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:55 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138" returned: 0 in 0.854s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:55 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 is being set with open permissions: ugo+rw
Apr 29 08:38:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:55 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138
Apr 29 08:38:55 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:55 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c4392be3-93db-4388-876d-bac05eec62c5" returned: 0 in 0.906s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Lock "cinder-quobyte-c4392be3-93db-4388-876d-bac05eec62c5" released by "delete_volume" :: held 1.840s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:56 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Created reservations ['f1a60b8e-89ad-4fec-9087-fbb87ee16ef0', '3f307fd7-b7e2-4dc7-8e10-c3455121c704', '5bce322b-33ca-4af4-9039-8c57800307e1', '1f9bcabd-4b64-42c5-943b-950b6fa3d9e6'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:56 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:56 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:56 devstack sudo[89504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:38:56 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:56 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138" returned: 0 in 0.857s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.948s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2465d8be-0f42-4b33-8116-e174d5c5dee2 tempest-VolumesDeleteCascade-1814472780 None] Create snapshot completed successfully
Apr 29 08:38:57 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.021s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Deleted volume successfully.
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6cdd9fe9-aa66-40a3-aea3-5b8737b09159 tempest-VolumesTransfersV357Test-625235683 None] Lock "cinder-c4392be3-93db-4388-876d-bac05eec62c5-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-09785077-1171-4a80-9a61-503073ab9cb1-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-09785077-1171-4a80-9a61-503073ab9cb1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Performing cascade delete. {{(pid=83885) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-5ec95eee-3102-4ea6-a5bf-25eae2064138-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-5ec95eee-3102-4ea6-a5bf-25eae2064138-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-09785077-1171-4a80-9a61-503073ab9cb1" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-09785077-1171-4a80-9a61-503073ab9cb1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-5ec95eee-3102-4ea6-a5bf-25eae2064138" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-5ec95eee-3102-4ea6-a5bf-25eae2064138" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Deleting offline snapshot 5ec95eee-3102-4ea6-a5bf-25eae2064138 of volume 09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] snapshot_file for this snap is: volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6688c46e-fab9-419c-b675-dbd6d70d0d48]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:58 devstack sudo[89508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138
Apr 29 08:38:58 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:59 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138" returned: 0 in 1.112s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09785077-1171-4a80-9a61-503073ab9cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba02de0f-dcb5-4905-9a60-e4fd734ca5f7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:59 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145
Apr 29 08:38:59 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Flow 'volume_create_manager' (7ba1c956-58a6-45e4-ae0c-f8e3c0bbc88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c949b8-69b5-490d-8b1e-4a84fdf32ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c949b8-69b5-490d-8b1e-4a84fdf32ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1410042260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d277dcc0d790473cab1c5b1a0cb4b049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:59Z,use_quota=True,user_id='23059ae5d80d44a9ba3879f233288b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93764b94-b6ab-45f3-a20d-acd6f6525c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93764b94-b6ab-45f3-a20d-acd6f6525c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d95503-2bf7-4186-a435-ba2876626c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d95503-2bf7-4186-a435-ba2876626c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b', 'volume_name': 'volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243d9851-daa8-4386-b1f4-cefe6cacfa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243d9851-daa8-4386-b1f4-cefe6cacfa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66de5e10-aa8e-4e5a-aaa4-a042dd5afa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:59 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Volume a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b', 'volume_size': 1}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1410042260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d277dcc0d790473cab1c5b1a0cb4b049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:59Z,use_quota=True,user_id='23059ae5d80d44a9ba3879f233288b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Creating volume a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:59 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:38:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:59 devstack sudo[89515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b 1073741824
Apr 29 08:38:59 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:00 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145" returned: 0 in 1.145s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09785077-1171-4a80-9a61-503073ab9cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:00 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138
Apr 29 08:39:00 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:00 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b 1073741824" returned: 0 in 1.040s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:00 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b
Apr 29 08:39:00 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:01 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138" returned: 0 in 1.057s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:01 devstack sudo[89531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138
Apr 29 08:39:01 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:01 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" returned: 0 in 0.892s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66de5e10-aa8e-4e5a-aaa4-a042dd5afa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbabcf7e-a4b6-49ac-ade6-ae8b38572b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:01 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Volume volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b (a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b): created successfully
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbabcf7e-a4b6-49ac-ade6-ae8b38572b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Flow 'volume_create_manager' (7ba1c956-58a6-45e4-ae0c-f8e3c0bbc88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-46f173c8-eafb-41f1-bee7-877f39ce1581 tempest-SnapshotMetadataTestJSON-546371409 None] Created volume successfully.
Apr 29 08:39:01 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.5ec95eee-3102-4ea6-a5bf-25eae2064138" returned: 0 in 0.709s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-5ec95eee-3102-4ea6-a5bf-25eae2064138" released by "_delete_snapshot" :: held 4.174s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-09785077-1171-4a80-9a61-503073ab9cb1" released by "delete_snapshot" :: held 4.225s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Created reservations ['046a5d5d-ec69-4428-86cb-bf68ec5ee785', '7de4ceb7-f2b7-46a1-8e01-c69fa4b1013c', 'f65842d9-703b-4838-b8ea-a0b83ab4baa8', 'b628ebbe-3f20-432c-b400-380a756cfacd'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Delete snapshot completed successfully.
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-5ec95eee-3102-4ea6-a5bf-25eae2064138-delete_snapshot" released by "delete_snapshot" :: held 4.409s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-81f47621-7a6a-4382-bcc0-15fd138c1145-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-81f47621-7a6a-4382-bcc0-15fd138c1145-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-09785077-1171-4a80-9a61-503073ab9cb1" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-09785077-1171-4a80-9a61-503073ab9cb1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-81f47621-7a6a-4382-bcc0-15fd138c1145" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-81f47621-7a6a-4382-bcc0-15fd138c1145" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Deleting offline snapshot 81f47621-7a6a-4382-bcc0-15fd138c1145 of volume 09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] snapshot_file for this snap is: volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[9358c857-e554-4dd6-aec0-1c155a155fc1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:02 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145
Apr 29 08:39:02 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:03 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145" returned: 0 in 0.852s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09785077-1171-4a80-9a61-503073ab9cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1aedd2-4ac2-4ed3-99b1-62ad9d0a0960]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Creating offline snapshot 5a0703bf-c752-4d3a-b2d3-395f30e07872 of volume a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a395df1-0032-4579-86c9-46da1fcd540f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:03 devstack sudo[89541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1
Apr 29 08:39:03 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:03 devstack sudo[89542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b
Apr 29 08:39:03 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:03 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (46c3c551-ed0d-4c98-ba46-c83fb7ceb557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8219d8fe-ecea-4553-a2cd-76d62209950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8219d8fe-ecea-4553-a2cd-76d62209950f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2077898833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625be74e-301b-4e0d-ada6-f8b17ffa9cb2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:04Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef33d835-6fca-4d32-8def-400890b38204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef33d835-6fca-4d32-8def-400890b38204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de96515-f916-435d-b4cc-a46ac44123ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de96515-f916-435d-b4cc-a46ac44123ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625be74e-301b-4e0d-ada6-f8b17ffa9cb2', 'volume_name': 'volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35148899-a957-4e27-b1a1-3ec30fc8eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:04 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35148899-a957-4e27-b1a1-3ec30fc8eaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da623305-f837-42ae-bf3e-0549acab5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:04 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Volume 625be74e-301b-4e0d-ada6-f8b17ffa9cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2', 'volume_size': 1}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1" returned: 0 in 0.888s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:04 devstack sudo[89552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145
Apr 29 08:39:04 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:04 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" returned: 0 in 0.930s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:04 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 1G
Apr 29 08:39:04 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:04 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145" returned: 0 in 0.796s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:04 devstack sudo[89563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145
Apr 29 08:39:04 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:05 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 1G" returned: 0 in 0.871s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:05 devstack sudo[89565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872
Apr 29 08:39:05 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:05 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1.81f47621-7a6a-4382-bcc0-15fd138c1145" returned: 0 in 0.621s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-81f47621-7a6a-4382-bcc0-15fd138c1145" released by "_delete_snapshot" :: held 3.292s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-09785077-1171-4a80-9a61-503073ab9cb1" released by "delete_snapshot" :: held 3.315s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Created reservations ['13a418f0-bafd-4b38-a799-9da784895ce2', '6816c097-1adf-4bae-925c-d4e70026f0b1', 'db76289c-0197-4ed8-a378-121b1c74e3ba', '6bca7da8-740b-4a3f-b434-faa22c33baf3'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:05 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Delete snapshot completed successfully.
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-81f47621-7a6a-4382-bcc0-15fd138c1145-delete_snapshot" released by "delete_snapshot" :: held 3.473s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Snapshots deleted, issuing volume delete {{(pid=83885) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-09785077-1171-4a80-9a61-503073ab9cb1" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-09785077-1171-4a80-9a61-503073ab9cb1" acquired by "delete_volume" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45a1023-210f-467c-b388-3899a89054c2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:05 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872" returned: 0 in 0.687s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:05 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 is being set with open permissions: ugo+rw
Apr 29 08:39:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:05 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872
Apr 29 08:39:05 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:05 devstack sudo[89571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1
Apr 29 08:39:05 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:06 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872" returned: 0 in 0.680s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:06 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.info
Apr 29 08:39:06 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:06 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1" returned: 0 in 0.832s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:06 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1
Apr 29 08:39:06 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:07 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.info" returned: 0 in 0.618s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:07 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.info is being set with open permissions: ugo+rw
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:07 devstack sudo[89585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.info
Apr 29 08:39:07 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:07 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-09785077-1171-4a80-9a61-503073ab9cb1" returned: 0 in 0.620s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-09785077-1171-4a80-9a61-503073ab9cb1" released by "delete_volume" :: held 1.517s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Created reservations ['69dea1a2-26f4-4b5a-9f51-9576359675d7', 'd8fd005d-15a6-4f3a-841a-03177859ca6a', '225136ff-f15c-4c13-b6db-1d4b7844fd79', '74ff71ba-5a3e-433f-9edd-c01b1dce7cc1'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:07 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:07 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:07 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.info" returned: 0 in 0.628s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.535s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.675s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2077898833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625be74e-301b-4e0d-ada6-f8b17ffa9cb2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:04Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Creating volume 625be74e-301b-4e0d-ada6-f8b17ffa9cb2 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:07 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:07 devstack sudo[89590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2 1073741824
Apr 29 08:39:07 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:07 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b9013195-1991-4927-b274-5350c03dfaac tempest-SnapshotMetadataTestJSON-546371409 None] Create snapshot completed successfully
Apr 29 08:39:07 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.631s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:07 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:07 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Deleted volume successfully.
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-10d6a99e-1716-4857-bb8b-9463670e3eeb tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-09785077-1171-4a80-9a61-503073ab9cb1-delete_volume" released by "delete_volume" :: held 10.320s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Flow 'volume_create_manager' (806a2398-b843-4422-8add-5ef11e35dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e6964-3279-4c40-bea5-41279b657a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e6964-3279-4c40-bea5-41279b657a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1046402935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcf2d13-5e72-496d-8450-0ae8abc8b1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6745040dbd454d24b9bc8d63f49c4d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:08Z,use_quota=True,user_id='37f85068267540e99238c77eed65a85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58b5e57-ce4f-42ac-8898-004cfbb10920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58b5e57-ce4f-42ac-8898-004cfbb10920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d4a5cd-4590-4d8c-b74b-e9013296240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d4a5cd-4590-4d8c-b74b-e9013296240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edcf2d13-5e72-496d-8450-0ae8abc8b1a9', 'volume_name': 'volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3542669b-a3b5-4983-845d-35aba676f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3542669b-a3b5-4983-845d-35aba676f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e04a95-a7fc-4483-8c41-3fcf80f80a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:08 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Volume edcf2d13-5e72-496d-8450-0ae8abc8b1a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9', 'volume_size': 1}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:08 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2 1073741824" returned: 0 in 1.043s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:08 devstack sudo[89596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2
Apr 29 08:39:08 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Acquiring lock "cinder-5a0703bf-c752-4d3a-b2d3-395f30e07872-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-5a0703bf-c752-4d3a-b2d3-395f30e07872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Acquiring lock "cinder-quobyte-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-quobyte-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Acquiring lock "cinder-quobyte-5a0703bf-c752-4d3a-b2d3-395f30e07872" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-quobyte-5a0703bf-c752-4d3a-b2d3-395f30e07872" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Deleting offline snapshot 5a0703bf-c752-4d3a-b2d3-395f30e07872 of volume a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] snapshot_file for this snap is: volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c6e6db-4333-444e-8434-2da69966a297]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:09 devstack sudo[89598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872
Apr 29 08:39:09 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:09 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2" returned: 0 in 0.791s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1046402935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcf2d13-5e72-496d-8450-0ae8abc8b1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6745040dbd454d24b9bc8d63f49c4d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:08Z,use_quota=True,user_id='37f85068267540e99238c77eed65a85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Creating volume edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:09 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da623305-f837-42ae-bf3e-0549acab5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:09 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 1073741824
Apr 29 08:39:09 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d7aa3d-7ce0-4089-a7e6-3aa88ab23116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:09 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Volume volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2 (625be74e-301b-4e0d-ada6-f8b17ffa9cb2): created successfully
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d7aa3d-7ce0-4089-a7e6-3aa88ab23116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (46c3c551-ed0d-4c98-ba46-c83fb7ceb557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-44720e09-19c9-461e-9cc8-7ea302791590 tempest-VolumesGetTest-1968490074 None] Created volume successfully.
Apr 29 08:39:10 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872" returned: 0 in 0.839s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:10 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[df02bd67-4372-4378-93e9-5eb90c75bacb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:10 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b
Apr 29 08:39:10 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:10 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 1073741824" returned: 0 in 1.116s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:10 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9
Apr 29 08:39:10 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:10 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" returned: 0 in 0.866s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:11 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872
Apr 29 08:39:11 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (84c3cc76-f939-494b-993b-ca253acfa8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62476010-ed8d-4a42-a10f-82adf1c002d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62476010-ed8d-4a42-a10f-82adf1c002d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2076416733',display_name='tempest-VolumesGetTest-Volume-2135706794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f6389d-3982-468b-a78d-0fe3f19f2112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:11Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff5f43-92fa-46ca-9acb-233fbb73f590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff5f43-92fa-46ca-9acb-233fbb73f590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf12c92b-6008-475e-a7d1-24bec827290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf12c92b-6008-475e-a7d1-24bec827290d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f6389d-3982-468b-a78d-0fe3f19f2112', 'volume_name': 'volume-17f6389d-3982-468b-a78d-0fe3f19f2112', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61240c4d-dc23-4855-825b-c4a335549e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61240c4d-dc23-4855-825b-c4a335549e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045fee02-5de2-41f0-850d-6449ab1e1782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Volume 17f6389d-3982-468b-a78d-0fe3f19f2112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f6389d-3982-468b-a78d-0fe3f19f2112', 'volume_size': 1}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:11 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" returned: 0 in 0.827s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.225s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2076416733',display_name='tempest-VolumesGetTest-Volume-2135706794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f6389d-3982-468b-a78d-0fe3f19f2112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:11Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Creating volume 17f6389d-3982-468b-a78d-0fe3f19f2112 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:11 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:11 devstack sudo[89623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112 1073741824
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e04a95-a7fc-4483-8c41-3fcf80f80a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b28b8f-1bbc-4454-a83b-588625b4f798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Volume volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 (edcf2d13-5e72-496d-8450-0ae8abc8b1a9): created successfully
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b28b8f-1bbc-4454-a83b-588625b4f798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Flow 'volume_create_manager' (806a2398-b843-4422-8add-5ef11e35dc35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:11 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-bb056a34-7299-435e-9933-a78b71f52d47 tempest-VolumesDeleteCascade-1814472780 None] Created volume successfully.
Apr 29 08:39:11 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872" returned: 0 in 0.963s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:11 devstack sudo[89626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872
Apr 29 08:39:11 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:12 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b.5a0703bf-c752-4d3a-b2d3-395f30e07872" returned: 0 in 0.662s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-quobyte-5a0703bf-c752-4d3a-b2d3-395f30e07872" released by "_delete_snapshot" :: held 3.469s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-quobyte-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" released by "delete_snapshot" :: held 3.501s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:12 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112 1073741824" returned: 0 in 0.971s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:12 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112
Apr 29 08:39:12 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:12 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Created reservations ['9e983d7a-56c9-4c27-b542-46676bdec4f8', 'ed22a1ef-3451-4cdf-ae69-8b0d6bf21f29', 'c34875c4-c825-4192-b344-6fe74715a539', 'b33a0858-1c58-488b-aa1b-20e8c63dc489'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:12 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Delete snapshot completed successfully.
Apr 29 08:39:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4db1241b-7c49-4041-a580-5034cd95fd98 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-5a0703bf-c752-4d3a-b2d3-395f30e07872-delete_snapshot" released by "delete_snapshot" :: held 3.733s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:13 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112" returned: 0 in 0.614s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.579s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045fee02-5de2-41f0-850d-6449ab1e1782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f6389d-3982-468b-a78d-0fe3f19f2112', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38dfa4e2-e583-4354-abd4-55feb18674f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Creating offline snapshot f0c9cf88-3b42-4f83-9618-25abe7130136 of volume edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:39:13 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Volume volume-17f6389d-3982-468b-a78d-0fe3f19f2112 (17f6389d-3982-468b-a78d-0fe3f19f2112): created successfully
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38dfa4e2-e583-4354-abd4-55feb18674f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (84c3cc76-f939-494b-993b-ca253acfa8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b13884b-90a1-4e82-b315-1564ee8b5269]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:13 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5aab6528-4dbd-4fbb-bb51-dda22ba3129d tempest-VolumesGetTest-1968490074 None] Created volume successfully.
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Acquiring lock "cinder-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:13 devstack sudo[89637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9
Apr 29 08:39:13 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Acquiring lock "cinder-quobyte-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-quobyte-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dd09e9-201e-490e-8967-708dab3c2baf]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:13 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b
Apr 29 08:39:13 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:14 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" returned: 0 in 0.809s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:14 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 1G
Apr 29 08:39:14 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:14 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" returned: 0 in 0.765s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:14 devstack sudo[89650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b
Apr 29 08:39:14 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-17f6389d-3982-468b-a78d-0fe3f19f2112-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Lock "cinder-17f6389d-3982-468b-a78d-0fe3f19f2112-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-quobyte-17f6389d-3982-468b-a78d-0fe3f19f2112" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-17f6389d-3982-468b-a78d-0fe3f19f2112" acquired by "delete_volume" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78985ad-803d-412b-be71-9af6a011d5dc]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:15 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112
Apr 29 08:39:15 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:15 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" returned: 0 in 0.815s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:15 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 1G" returned: 0 in 1.015s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-quobyte-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b" released by "delete_volume" :: held 1.678s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:15 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136
Apr 29 08:39:15 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Created reservations ['a8b8394f-d949-4eac-a37c-a9996973008a', 'ec919733-1648-4da0-993e-6c34fa89863d', '4fec5d3b-5b5b-4edb-98d7-b616be9cc82a', '0e0891eb-49ca-4c93-a915-a5d0ac48fe30'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:15 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:15 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:15 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112" returned: 0 in 0.962s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:15 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112
Apr 29 08:39:15 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:16 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136" returned: 0 in 0.974s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:16 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 is being set with open permissions: ugo+rw
Apr 29 08:39:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:16 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136
Apr 29 08:39:16 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:16 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.021s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:16 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:16 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Deleted volume successfully.
Apr 29 08:39:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a533ce47-cdd4-42eb-a665-1b6c445eed97 tempest-SnapshotMetadataTestJSON-546371409 None] Lock "cinder-a57d6b3e-54e3-43ba-9a73-92e2d8ec7b1b-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:16 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-17f6389d-3982-468b-a78d-0fe3f19f2112" returned: 0 in 0.938s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-17f6389d-3982-468b-a78d-0fe3f19f2112" released by "delete_volume" :: held 1.992s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:16 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Created reservations ['d5b556bf-af5e-478d-838a-48f5432cc903', 'a348fde6-387d-4f75-9151-2f6da4ac3585', 'f4111fdf-30e3-478a-b937-11a35d1dc513', '81ddf914-791c-4cd8-aab0-3316dc2adef2'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:17 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:17 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:17 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136" returned: 0 in 0.944s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-625be74e-301b-4e0d-ada6-f8b17ffa9cb2-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Lock "cinder-625be74e-301b-4e0d-ada6-f8b17ffa9cb2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:17 devstack sudo[89679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.info
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-quobyte-625be74e-301b-4e0d-ada6-f8b17ffa9cb2" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:17 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-625be74e-301b-4e0d-ada6-f8b17ffa9cb2" acquired by "delete_volume" :: waited 0.047s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af767a4-b6f6-4c5b-9d9d-b4f4eefc2227]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:17 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2
Apr 29 08:39:17 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:17 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.939s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:17 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Deleted volume successfully.
Apr 29 08:39:18 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=166,cinder:DELETE=16,cinder:SELECT=124,cinder:INSERT=45 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:39:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0e0af0c0-1f49-4685-9534-068caa84e6a1 tempest-VolumesGetTest-1968490074 None] Lock "cinder-17f6389d-3982-468b-a78d-0fe3f19f2112-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:18 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.info" returned: 0 in 0.845s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:18 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.info is being set with open permissions: ugo+rw
Apr 29 08:39:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:18 devstack sudo[89685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.info
Apr 29 08:39:18 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:18 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2" returned: 0 in 0.979s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:18 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2
Apr 29 08:39:18 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:18 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.info" returned: 0 in 0.793s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.594s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-bebafd27-b120-473f-877b-b66db9f78487 tempest-VolumesDeleteCascade-1814472780 None] Create snapshot completed successfully
Apr 29 08:39:19 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-625be74e-301b-4e0d-ada6-f8b17ffa9cb2" returned: 0 in 0.675s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-625be74e-301b-4e0d-ada6-f8b17ffa9cb2" released by "delete_volume" :: held 1.716s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Created reservations ['df60c38b-5dab-4ed4-8f0e-7871233f26cc', '9677e49e-a4ba-45a2-97af-ef360d717d7d', '6f57538e-e330-49d4-9bbd-06a4c305d741', '874ecbf4-b29d-4b06-949c-a2ad988ec8a9'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:19 devstack sudo[89729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:19 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Flow 'volume_create_manager' (ad9d9b46-02b9-43ec-a322-c69cf018806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582768b3-2c29-4b14-8638-a5093a5ab612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582768b3-2c29-4b14-8638-a5093a5ab612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1008495763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bbb36c-2fcd-429c-95a1-9c5b196f4d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6745040dbd454d24b9bc8d63f49c4d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0c9cf88-3b42-4f83-9618-25abe7130136,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:20Z,use_quota=True,user_id='37f85068267540e99238c77eed65a85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35888af7-d191-4f04-98e4-a2244e263ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35888af7-d191-4f04-98e4-a2244e263ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f50ba2f-ef11-40f5-90b0-de76a86df816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f50ba2f-ef11-40f5-90b0-de76a86df816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44bbb36c-2fcd-429c-95a1-9c5b196f4d4c', 'volume_name': 'volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c', 'volume_size': 1, 'snapshot_id': 'f0c9cf88-3b42-4f83-9618-25abe7130136'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc985a3f-4e64-4b6b-9420-35328f3e8a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc985a3f-4e64-4b6b-9420-35328f3e8a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0089b52e-e8e8-4bde-abee-8c5bc81c4d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:19 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Volume 44bbb36c-2fcd-429c-95a1-9c5b196f4d4c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c', 'volume_size': 1, 'snapshot_id': 'f0c9cf88-3b42-4f83-9618-25abe7130136'}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-f0c9cf88-3b42-4f83-9618-25abe7130136-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" by "_create_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-f0c9cf88-3b42-4f83-9618-25abe7130136-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Creating volume 44bbb36c-2fcd-429c-95a1-9c5b196f4d4c from snapshot f0c9cf88-3b42-4f83-9618-25abe7130136 {{(pid=83885) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] snapshot: f0c9cf88-3b42-4f83-9618-25abe7130136, volume: 44bbb36c-2fcd-429c-95a1-9c5b196f4d4c,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[400bf782-ec7a-4000-8841-a7cf9b8ab5c1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:20 devstack sudo[89733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136
Apr 29 08:39:20 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:20 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (2c4e9ba8-1194-43fb-a548-ecd188462625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc46ca39-e2db-49e6-a29e-568615a54e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.147s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc46ca39-e2db-49e6-a29e-568615a54e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2024497525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30999c64-cd2f-48d1-9d02-4c852fc1c363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:20Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebb4d63-8428-4c44-af27-f21489d18ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebb4d63-8428-4c44-af27-f21489d18ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82eab29-fefd-4ca1-aaff-fe9b9efe1ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82eab29-fefd-4ca1-aaff-fe9b9efe1ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30999c64-cd2f-48d1-9d02-4c852fc1c363', 'volume_name': 'volume-30999c64-cd2f-48d1-9d02-4c852fc1c363', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d893de-407f-4fa9-b35b-c66a72f378c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d893de-407f-4fa9-b35b-c66a72f378c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735c3e8e-666d-4871-9e1a-0cd0f25466e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:20 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Volume 30999c64-cd2f-48d1-9d02-4c852fc1c363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30999c64-cd2f-48d1-9d02-4c852fc1c363', 'volume_size': 1}
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:20 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Deleted volume successfully.
Apr 29 08:39:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7796aeed-3dbb-47f5-aae9-88cfed09be86 tempest-VolumesGetTest-1968490074 None] Lock "cinder-625be74e-301b-4e0d-ada6-f8b17ffa9cb2-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:21 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136" returned: 0 in 0.854s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a094ca8a-f080-4ee4-a6b0-b3adc05b496e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Flow 'volume_create_manager' (71eda6c5-5c48-4472-abf5-6ab39993362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b28a4c-5bad-419d-8703-a43ea40a89f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:21 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9
Apr 29 08:39:21 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b28a4c-5bad-419d-8703-a43ea40a89f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1744703826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03cb238b-394c-415f-8810-43d7964ba809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dbf3093f144b71926ee2737ad9b036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:21Z,use_quota=True,user_id='28c48155784047dbb8fc6f8d2906e3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d40aaa-fbd5-451d-a857-a9c107e4d17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d40aaa-fbd5-451d-a857-a9c107e4d17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd960d62-2ff1-49af-9d50-a1c7eed9e510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd960d62-2ff1-49af-9d50-a1c7eed9e510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03cb238b-394c-415f-8810-43d7964ba809', 'volume_name': 'volume-03cb238b-394c-415f-8810-43d7964ba809', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f886916a-723b-4a32-8abe-89e0f49c5109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f886916a-723b-4a32-8abe-89e0f49c5109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2ca436-8b8f-417c-ad84-c99056b1574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:21 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Volume 03cb238b-394c-415f-8810-43d7964ba809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03cb238b-394c-415f-8810-43d7964ba809', 'volume_size': 1}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:21 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" returned: 0 in 0.804s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:39:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:21 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c
Apr 29 08:39:21 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Flow 'volume_create_manager' (e5fffb40-a654-452f-8a78-d4aba8ec3590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f351ed77-caea-4529-a06e-2d6568848857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f351ed77-caea-4529-a06e-2d6568848857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-169960937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8780fbc-5e15-4c9f-bdbd-1992880ade7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce779f8e5474fd78552ca04bb7548a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:23Z,use_quota=True,user_id='eeac2db9a81845ce9f1412c824260cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fef23bb-33c8-41c2-8934-64aa639b9e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fef23bb-33c8-41c2-8934-64aa639b9e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8886fc0e-f8c5-4286-aca2-e0af1d928596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8886fc0e-f8c5-4286-aca2-e0af1d928596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8780fbc-5e15-4c9f-bdbd-1992880ade7e', 'volume_name': 'volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfee18e-ef8c-4d89-b57a-d5f117e81536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfee18e-ef8c-4d89-b57a-d5f117e81536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cad862-3989-40e2-b275-326798165f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Volume d8780fbc-5e15-4c9f-bdbd-1992880ade7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e', 'volume_size': 1}
Apr 29 08:39:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:26 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" returned: 0 in 4.411s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:26 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e397152-43c8-481d-9cc9-6405ebbba452]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:26 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9
Apr 29 08:39:26 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:27 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" returned: 0 in 0.839s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:39:27 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Converted 1024.00 MB image at 232.11 MB/s
Apr 29 08:39:27 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c is being set with open permissions: ugo+rw
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:27 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c
Apr 29 08:39:27 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:27 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" returned: 0 in 0.598s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" released by "_copy_volume_from_snapshot" :: held 7.658s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-f0c9cf88-3b42-4f83-9618-25abe7130136-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" released by "_create_volume_from_snapshot" :: held 7.710s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.743s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.240s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2024497525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30999c64-cd2f-48d1-9d02-4c852fc1c363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:20Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Creating volume 30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:27 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:27 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 1073741824
Apr 29 08:39:27 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=128,cinder:UPDATE=173,cinder:DELETE=14,cinder:INSERT=35 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0089b52e-e8e8-4bde-abee-8c5bc81c4d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c', 'volume_size': 1, 'snapshot_id': 'f0c9cf88-3b42-4f83-9618-25abe7130136'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f82eff7-6ee8-48d0-8b55-b540511227c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:27 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Volume volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c (44bbb36c-2fcd-429c-95a1-9c5b196f4d4c): created successfully
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f82eff7-6ee8-48d0-8b55-b540511227c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Flow 'volume_create_manager' (ad9d9b46-02b9-43ec-a322-c69cf018806e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:27 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4878528a-c7e9-4959-a24f-f789a3862e8a tempest-VolumesDeleteCascade-1814472780 None] Created volume successfully.
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-edcf2d13-5e72-496d-8450-0ae8abc8b1a9-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-edcf2d13-5e72-496d-8450-0ae8abc8b1a9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:28 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 1073741824" returned: 0 in 0.812s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Performing cascade delete. {{(pid=83885) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-f0c9cf88-3b42-4f83-9618-25abe7130136-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-f0c9cf88-3b42-4f83-9618-25abe7130136-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:28 devstack sudo[89776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363
Apr 29 08:39:28 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-f0c9cf88-3b42-4f83-9618-25abe7130136" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-f0c9cf88-3b42-4f83-9618-25abe7130136" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Deleting offline snapshot f0c9cf88-3b42-4f83-9618-25abe7130136 of volume edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] snapshot_file for this snap is: volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e78adc-6104-4073-b03d-79ec6b114cff]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:28 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136
Apr 29 08:39:28 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:29 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363" returned: 0 in 0.607s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1744703826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03cb238b-394c-415f-8810-43d7964ba809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79dbf3093f144b71926ee2737ad9b036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:21Z,use_quota=True,user_id='28c48155784047dbb8fc6f8d2906e3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Creating volume 03cb238b-394c-415f-8810-43d7964ba809 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:29 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735c3e8e-666d-4871-9e1a-0cd0f25466e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30999c64-cd2f-48d1-9d02-4c852fc1c363', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:29 devstack sudo[89781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809 1073741824
Apr 29 08:39:29 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c2d57a-cbf9-4372-b17b-02dc7b6a3fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:29 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Volume volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 (30999c64-cd2f-48d1-9d02-4c852fc1c363): created successfully
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c2d57a-cbf9-4372-b17b-02dc7b6a3fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (2c4e9ba8-1194-43fb-a548-ecd188462625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e9d37fd4-de51-4f77-a5e4-cb77cf3c8bf5 tempest-VolumesGetTest-1968490074 None] Created volume successfully.
Apr 29 08:39:29 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136" returned: 0 in 0.709s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0066dd-3701-41d5-8404-58ccc2362251]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:29 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9
Apr 29 08:39:29 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:30 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809 1073741824" returned: 0 in 0.848s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:30 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809
Apr 29 08:39:30 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:30 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" returned: 0 in 0.741s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:30 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136
Apr 29 08:39:30 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (4fd8b6ad-773a-4677-a8c2-776898f92220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675e2830-1e90-4cf3-b5e2-6f31e1315405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675e2830-1e90-4cf3-b5e2-6f31e1315405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-917536395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65381724-e167-4590-837e-5bcafa3415ca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=30999c64-cd2f-48d1-9d02-4c852fc1c363,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:30Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81be380-ac9a-43a3-9f0c-4ba617317776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81be380-ac9a-43a3-9f0c-4ba617317776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fd79cf-3f42-4065-a020-e5fd302c3e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fd79cf-3f42-4065-a020-e5fd302c3e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '65381724-e167-4590-837e-5bcafa3415ca', 'volume_name': 'volume-65381724-e167-4590-837e-5bcafa3415ca', 'volume_size': 1, 'source_volid': '30999c64-cd2f-48d1-9d02-4c852fc1c363', 'source_volstatus': 'available'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6087b9d-a756-4092-9514-16de0b306a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6087b9d-a756-4092-9514-16de0b306a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591dc226-b955-4800-b6cf-b8cf7cca4f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Volume 65381724-e167-4590-837e-5bcafa3415ca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-65381724-e167-4590-837e-5bcafa3415ca', 'volume_size': 1, 'source_volid': '30999c64-cd2f-48d1-9d02-4c852fc1c363', 'source_volstatus': 'available'}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:30 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809" returned: 0 in 0.724s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.036s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-169960937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8780fbc-5e15-4c9f-bdbd-1992880ade7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce779f8e5474fd78552ca04bb7548a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:23Z,use_quota=True,user_id='eeac2db9a81845ce9f1412c824260cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Creating volume d8780fbc-5e15-4c9f-bdbd-1992880ade7e {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:30 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2ca436-8b8f-417c-ad84-c99056b1574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03cb238b-394c-415f-8810-43d7964ba809', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e 1073741824
Apr 29 08:39:30 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f8c3ff-cec8-4d27-822f-1c11a07a0b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Volume volume-03cb238b-394c-415f-8810-43d7964ba809 (03cb238b-394c-415f-8810-43d7964ba809): created successfully
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f8c3ff-cec8-4d27-822f-1c11a07a0b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Flow 'volume_create_manager' (71eda6c5-5c48-4472-abf5-6ab39993362e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:30 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-7c8a50e7-d5ed-4106-b760-0893f0ae2dad tempest-AbsoluteLimitsTests-215213257 None] Created volume successfully.
Apr 29 08:39:30 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136" returned: 0 in 0.771s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:31 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136
Apr 29 08:39:31 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:31 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9.f0c9cf88-3b42-4f83-9618-25abe7130136" returned: 0 in 0.694s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:31 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e 1073741824" returned: 0 in 0.809s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-f0c9cf88-3b42-4f83-9618-25abe7130136" released by "_delete_snapshot" :: held 3.011s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" released by "delete_snapshot" :: held 3.038s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:31 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e
Apr 29 08:39:31 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Created reservations ['c8f52057-89ed-4318-94c2-5e42b2934afa', 'f73cd187-6476-45b8-b106-04b7cd3bf457', '4061cafc-6b3f-4cdc-aec3-a47f00d4f7ff', '6fcab970-b23f-46ee-a01b-5ea3ffbe0423'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:31 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Delete snapshot completed successfully.
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-f0c9cf88-3b42-4f83-9618-25abe7130136-delete_snapshot" released by "delete_snapshot" :: held 3.247s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Snapshots deleted, issuing volume delete {{(pid=83885) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[488fb9cd-0f65-4bb5-bead-a1a35a08dd70]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:32 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9
Apr 29 08:39:32 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Acquiring lock "cinder-03cb238b-394c-415f-8810-43d7964ba809-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Lock "cinder-03cb238b-394c-415f-8810-43d7964ba809-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Acquiring lock "cinder-quobyte-03cb238b-394c-415f-8810-43d7964ba809" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Lock "cinder-quobyte-03cb238b-394c-415f-8810-43d7964ba809" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[724bb57e-1986-4d23-8323-a6d918fd4c99]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:32 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809
Apr 29 08:39:32 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:32 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e" returned: 0 in 0.706s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.917s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:32 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Cloning volume 30999c64-cd2f-48d1-9d02-4c852fc1c363 to volume 65381724-e167-4590-837e-5bcafa3415ca
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cad862-3989-40e2-b275-326798165f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ffc8de-732a-4629-85d6-8fac25fde364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:32 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Volume volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e (d8780fbc-5e15-4c9f-bdbd-1992880ade7e): created successfully
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ffc8de-732a-4629-85d6-8fac25fde364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Flow 'volume_create_manager' (e5fffb40-a654-452f-8a78-d4aba8ec3590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:32 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3e67f86d-ac28-4b74-9bbf-8acb16dcf0b4 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Created volume successfully.
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Creating offline snapshot 092fc4ba-c2b6-434c-90d6-60bdf336024f of volume 30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd4043f-0b51-49a9-8db6-dc3a30718f9e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:32 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363
Apr 29 08:39:32 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:32 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" returned: 0 in 0.792s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:32 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9
Apr 29 08:39:32 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:33 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809" returned: 0 in 0.802s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:33 devstack sudo[89835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809
Apr 29 08:39:33 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:33 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363" returned: 0 in 0.802s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:33 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f 1G
Apr 29 08:39:33 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:33 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" returned: 0 in 0.703s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-edcf2d13-5e72-496d-8450-0ae8abc8b1a9" released by "delete_volume" :: held 1.585s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Created reservations ['d64a1951-8cda-494e-aaee-54f220daf4dd', 'c4910778-021b-457e-b7ec-244e5637315f', '34b1e678-62d6-4ba0-8acf-4499000f6dcd', '4810bd18-cf0c-46dd-939f-71db4ebab6e7'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:33 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:33 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:33 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Acquiring lock "cinder-d8780fbc-5e15-4c9f-bdbd-1992880ade7e-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-03cb238b-394c-415f-8810-43d7964ba809" returned: 0 in 0.698s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Lock "cinder-quobyte-03cb238b-394c-415f-8810-43d7964ba809" released by "delete_volume" :: held 1.554s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "cinder-d8780fbc-5e15-4c9f-bdbd-1992880ade7e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Acquiring lock "cinder-quobyte-d8780fbc-5e15-4c9f-bdbd-1992880ade7e" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "cinder-quobyte-d8780fbc-5e15-4c9f-bdbd-1992880ade7e" acquired by "delete_volume" :: waited 0.034s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Created reservations ['2e8eacde-b4f5-4235-a9c0-391d1725aaef', '2af2f46d-1459-4784-a2b6-5499468fb68c', '2446dabe-7ff2-4367-830f-3937a5683eb1', 'a82ae427-5dd4-46d1-8f9a-d9924585861c'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dd4a5c-42fb-4838-b0d9-527c40177e63]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:34 devstack sudo[89849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e
Apr 29 08:39:34 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:34 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:34 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "cinder-quobyte-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790e4dd-685a-4f50-80e6-f07f2f4a3b3a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:34 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c
Apr 29 08:39:34 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:34 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f 1G" returned: 0 in 1.140s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:34 devstack sudo[89858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f
Apr 29 08:39:34 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:34 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.987s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:34 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Deleted volume successfully.
Apr 29 08:39:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4e93d08f-8791-409e-b95c-fbacefc9b4be tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-edcf2d13-5e72-496d-8450-0ae8abc8b1a9-delete_volume" released by "delete_volume" :: held 6.144s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:35 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.052s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:35 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:35 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Deleted volume successfully.
Apr 29 08:39:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-94033660-282c-483e-8c18-69da7a4fb127 tempest-AbsoluteLimitsTests-215213257 None] Lock "cinder-03cb238b-394c-415f-8810-43d7964ba809-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:35 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:35 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" returned: 0 in 1.046s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:35 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f" returned: 0 in 0.831s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:35 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f is being set with open permissions: ugo+rw
Apr 29 08:39:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e" returned: 0 in 1.376s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:35 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c
Apr 29 08:39:35 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:35 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f
Apr 29 08:39:35 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:35 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e
Apr 29 08:39:35 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:36 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" returned: 0 in 0.686s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-quobyte-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c" released by "delete_volume" :: held 1.801s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:36 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d8780fbc-5e15-4c9f-bdbd-1992880ade7e" returned: 0 in 0.704s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "cinder-quobyte-d8780fbc-5e15-4c9f-bdbd-1992880ade7e" released by "delete_volume" :: held 2.172s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Created reservations ['c3020310-8505-481b-b001-9399ba760573', 'e252b8c4-141e-4047-a39f-c849387a8f3a', '6370950e-d841-46d9-853c-f7659590e44a', 'd96f60c3-0c4a-4caf-a445-11e978f76dd2'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Created reservations ['836ef933-b2e2-4cf5-9a3c-b6fe4443ec9b', '6745bf0b-7250-4e75-b50d-2d19770967ab', '350f5d33-d3d1-4b6b-9f8c-73d496adcd9e', '266e3b7a-71de-4613-a5f7-021921225b31'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:36 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f" returned: 0 in 0.834s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:36 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.info
Apr 29 08:39:36 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:36 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:36 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:36 devstack sudo[89883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:36 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:37 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.info" returned: 0 in 0.842s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:37 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.info is being set with open permissions: ugo+rw
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:37 devstack sudo[89888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.info
Apr 29 08:39:37 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:37 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.865s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:37 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.839s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:37 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Deleted volume successfully.
Apr 29 08:39:37 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Deleted volume successfully.
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af8187b8-0025-4792-9c71-0c2c80bab1c2 tempest-VolumesDeleteCascade-1814472780 None] Lock "cinder-44bbb36c-2fcd-429c-95a1-9c5b196f4d4c-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-09242014-1eff-4365-b3af-d7b244944042 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "cinder-d8780fbc-5e15-4c9f-bdbd-1992880ade7e-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:37 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.info" returned: 0 in 0.832s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-quobyte-65381724-e167-4590-837e-5bcafa3415ca" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Flow 'volume_create_manager' (6e593f25-99d2-4f99-991d-26b56f54f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6088e1b-5b2a-45d2-b101-1ff65d035f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6088e1b-5b2a-45d2-b101-1ff65d035f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1869715870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82187819-c70f-4396-8763-55ae2f1b1ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce779f8e5474fd78552ca04bb7548a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:38Z,use_quota=True,user_id='eeac2db9a81845ce9f1412c824260cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41626e7-b7e0-4c1e-8234-49020987a730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41626e7-b7e0-4c1e-8234-49020987a730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfeaa70-0a2d-470f-b9b2-f47bf3031245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfeaa70-0a2d-470f-b9b2-f47bf3031245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82187819-c70f-4396-8763-55ae2f1b1ea1', 'volume_name': 'volume-82187819-c70f-4396-8763-55ae2f1b1ea1', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1400c2ef-8447-4aaf-bd3e-ddaad29cf8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1400c2ef-8447-4aaf-bd3e-ddaad29cf8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440fda6c-add2-4359-a29d-65df03d2847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:38 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Volume 82187819-c70f-4396-8763-55ae2f1b1ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82187819-c70f-4396-8763-55ae2f1b1ea1', 'volume_size': 1}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-65381724-e167-4590-837e-5bcafa3415ca" acquired by "_copy_volume_from_snapshot" :: waited 0.097s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] snapshot: 092fc4ba-c2b6-434c-90d6-60bdf336024f, volume: 65381724-e167-4590-837e-5bcafa3415ca,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[773195cd-e7c8-4d08-898a-c0db32cbce80]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:38 devstack sudo[89891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f
Apr 29 08:39:38 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:38 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f" returned: 0 in 0.835s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30999c64-cd2f-48d1-9d02-4c852fc1c363(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d3aaf9-d297-4e99-85b9-5864b84a98bb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:39 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363
Apr 29 08:39:39 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:39 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363" returned: 0 in 0.805s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:39 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:39:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:39 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca
Apr 29 08:39:39 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:41 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:41 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Flow 'volume_create_manager' (2b9174f3-8e3f-4d18-8f11-3839598bf1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:41 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64b8a1f-e622-4554-87c3-4858c5c10adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:41 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64b8a1f-e622-4554-87c3-4858c5c10adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2097041719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79738d39-4464-40e2-8a36-01e08d133480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5e490fe0214d259ea5bd0b323cb92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:41Z,use_quota=True,user_id='5a58e4e8577445b5ab6df1ce0a19a857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:41 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e988e-aeec-4ad6-b173-00dff50855be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:41 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e988e-aeec-4ad6-b173-00dff50855be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:41 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5604db-2189-4417-8922-34baa28b6525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:41 devstack cinder-volume[83885]: DEBUG cinder.image.glance [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Creating Keystone auth plugin from conf {{(pid=83885) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 08:39:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5604db-2189-4417-8922-34baa28b6525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79738d39-4464-40e2-8a36-01e08d133480', 'volume_name': 'volume-79738d39-4464-40e2-8a36-01e08d133480', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e4cacf0>}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf5111e-b58e-4415-a220-698f0d8455a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf5111e-b58e-4415-a220-698f0d8455a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98eb148-14c2-400b-9df4-880a3c45648d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:42 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Volume 79738d39-4464-40e2-8a36-01e08d133480: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79738d39-4464-40e2-8a36-01e08d133480', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e4cacf0>}
Apr 29 08:39:42 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Trying to clone 79738d39-4464-40e2-8a36-01e08d133480 from image b7d8ee2a-d63e-4da9-983e-f810d728a919 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]). {{(pid=83885) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 08:39:43 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Flow 'volume_create_manager' (910d1c33-5c84-4196-bf7e-c14a8a9a8a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a3616a-83bd-49a9-9ca3-3aff9ac8ce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[380fed7d-7149-455d-9a6c-79bc5699715f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a3616a-83bd-49a9-9ca3-3aff9ac8ce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2010355786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332cb3de-a990-4169-8b9d-8896dc5837e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3461d915da3461cbad341c40729d885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:43Z,use_quota=True,user_id='5ba324aed2cb4e5fb562edd7d7129450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4a3f5d-33f8-4353-b10e-87c4e20ad326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4a3f5d-33f8-4353-b10e-87c4e20ad326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abd48b1-ea03-4c79-ad33-f4a98ad2c24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abd48b1-ea03-4c79-ad33-f4a98ad2c24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332cb3de-a990-4169-8b9d-8896dc5837e8', 'volume_name': 'volume-332cb3de-a990-4169-8b9d-8896dc5837e8', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8caf4d51-7b39-4f12-a11c-434ec6f7c1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8caf4d51-7b39-4f12-a11c-434ec6f7c1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed052b8d-00b3-4b12-addb-0a7744c61ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:43 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Volume 332cb3de-a990-4169-8b9d-8896dc5837e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332cb3de-a990-4169-8b9d-8896dc5837e8', 'volume_size': 1}
Apr 29 08:39:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:43 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD
Apr 29 08:39:43 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:45 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD" returned: 0 in 2.007s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:45 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Temporary image b7d8ee2a-d63e-4da9-983e-f810d728a919 is fetched for user 5a58e4e8577445b5ab6df1ce0a19a857. {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 08:39:45 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04e9505-8050-471f-8ccf-8426e4a26c22]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:45 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca" returned: 0 in 5.597s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:45 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd287df-1623-4a64-9bd9-cb5b43518344]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:45 devstack sudo[89921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD
Apr 29 08:39:45 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:45 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363
Apr 29 08:39:45 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:46 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:46 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363" returned: 0 in 0.864s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:39:46 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Converted 1024.00 MB image at 182.92 MB/s
Apr 29 08:39:46 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca is being set with open permissions: ugo+rw
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:46 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca
Apr 29 08:39:46 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:46 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca" returned: 0 in 0.609s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-65381724-e167-4590-837e-5bcafa3415ca" released by "_copy_volume_from_snapshot" :: held 8.819s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-quobyte-092fc4ba-c2b6-434c-90d6-60bdf336024f" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-092fc4ba-c2b6-434c-90d6-60bdf336024f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Deleting offline snapshot 092fc4ba-c2b6-434c-90d6-60bdf336024f of volume 30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] snapshot_file for this snap is: volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d8ec55-a415-41c5-a207-502382aacd7c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:47 devstack sudo[89934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f
Apr 29 08:39:47 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:47 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f" returned: 0 in 0.737s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30999c64-cd2f-48d1-9d02-4c852fc1c363(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:47 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fba60e-7a25-4d16-937e-1aa2bfea05a3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:47 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363
Apr 29 08:39:47 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:48 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363" returned: 0 in 0.730s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:48 devstack sudo[89944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f
Apr 29 08:39:48 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:49 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f" returned: 0 in 0.703s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:49 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f
Apr 29 08:39:49 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:49 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363.092fc4ba-c2b6-434c-90d6-60bdf336024f" returned: 0 in 0.585s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-092fc4ba-c2b6-434c-90d6-60bdf336024f" released by "_delete_snapshot" :: held 2.847s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.295s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.736s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1869715870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82187819-c70f-4396-8763-55ae2f1b1ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce779f8e5474fd78552ca04bb7548a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:38Z,use_quota=True,user_id='eeac2db9a81845ce9f1412c824260cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Creating volume 82187819-c70f-4396-8763-55ae2f1b1ea1 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:49 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591dc226-b955-4800-b6cf-b8cf7cca4f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65381724-e167-4590-837e-5bcafa3415ca', 'volume_size': 1, 'source_volid': '30999c64-cd2f-48d1-9d02-4c852fc1c363', 'source_volstatus': 'available'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:49 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1 1073741824
Apr 29 08:39:49 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1d340b-c440-4fd0-9926-5df9e4d95544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:49 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Volume volume-65381724-e167-4590-837e-5bcafa3415ca (65381724-e167-4590-837e-5bcafa3415ca): created successfully
Apr 29 08:39:49 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:49 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1d340b-c440-4fd0-9926-5df9e4d95544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (4fd8b6ad-773a-4677-a8c2-776898f92220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:49 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-42f1576a-b5ae-42f2-8b87-a593072293d1 tempest-VolumesGetTest-1968490074 None] Created volume successfully.
Apr 29 08:39:50 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.646s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:50 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1 1073741824" returned: 0 in 0.952s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:50 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1
Apr 29 08:39:50 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (d0fa7606-d38d-407c-ab46-46c16b27ae4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3f1bf3-70f9-4ccd-b4c1-6d4fbbc32311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3f1bf3-70f9-4ccd-b4c1-6d4fbbc32311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1373670202',display_name='tempest-VolumesGetTest-Volume-1426715798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a131c9c-2398-4d14-8bb8-a73794c145bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:51Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4ee7ac-d9fd-4bfb-93d6-96043a16ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4ee7ac-d9fd-4bfb-93d6-96043a16ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1de2f45-f143-488e-ba7c-b1350a9fab75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1de2f45-f143-488e-ba7c-b1350a9fab75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a131c9c-2398-4d14-8bb8-a73794c145bb', 'volume_name': 'volume-0a131c9c-2398-4d14-8bb8-a73794c145bb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bed33f-c6b8-4446-aff8-0643ec50f78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bed33f-c6b8-4446-aff8-0643ec50f78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcef07d5-ccf4-4cf1-98d4-cbe2150e707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:51 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Volume 0a131c9c-2398-4d14-8bb8-a73794c145bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a131c9c-2398-4d14-8bb8-a73794c145bb', 'volume_size': 1}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:51 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1" returned: 0 in 0.628s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.050s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2010355786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332cb3de-a990-4169-8b9d-8896dc5837e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3461d915da3461cbad341c40729d885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:43Z,use_quota=True,user_id='5ba324aed2cb4e5fb562edd7d7129450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Creating volume 332cb3de-a990-4169-8b9d-8896dc5837e8 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:51 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440fda6c-add2-4359-a29d-65df03d2847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82187819-c70f-4396-8763-55ae2f1b1ea1', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5f9bed-f266-41e8-80eb-65a2388e2f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:51 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8 1073741824
Apr 29 08:39:51 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:51 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Volume volume-82187819-c70f-4396-8763-55ae2f1b1ea1 (82187819-c70f-4396-8763-55ae2f1b1ea1): created successfully
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5f9bed-f266-41e8-80eb-65a2388e2f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Flow 'volume_create_manager' (6e593f25-99d2-4f99-991d-26b56f54f453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:51 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2eb73d5c-4ff1-4b83-84c0-806454067261 tempest-VolumeQuotasAdminTestJSON-2081563873 None] Created volume successfully.
Apr 29 08:39:52 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8 1073741824" returned: 0 in 0.792s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:52 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8
Apr 29 08:39:52 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:52 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8" returned: 0 in 0.703s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.909s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2097041719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79738d39-4464-40e2-8a36-01e08d133480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5e490fe0214d259ea5bd0b323cb92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:41Z,use_quota=True,user_id='5a58e4e8577445b5ab6df1ce0a19a857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Creating volume 79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:52 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:52 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-083b1260-0e9b-415b-b443-cff8607210ce tempest-VolumeQuotasAdminTestJSON-402698356 None] Transfer volume completed successfully.
Apr 29 08:39:53 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 1073741824
Apr 29 08:39:53 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed052b8d-00b3-4b12-addb-0a7744c61ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332cb3de-a990-4169-8b9d-8896dc5837e8', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f0646d-de0c-4d00-9108-426440898d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:53 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Volume volume-332cb3de-a990-4169-8b9d-8896dc5837e8 (332cb3de-a990-4169-8b9d-8896dc5837e8): created successfully
Apr 29 08:39:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f0646d-de0c-4d00-9108-426440898d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Flow 'volume_create_manager' (910d1c33-5c84-4196-bf7e-c14a8a9a8a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:53 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-bf3ae23d-7f6a-43e7-9d7f-ce055229104b tempest-VolumesTransfersTest-1690854591 None] Created volume successfully.
Apr 29 08:39:53 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 1073741824" returned: 0 in 0.855s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:53 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480
Apr 29 08:39:53 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Acquiring lock "cinder-82187819-c70f-4396-8763-55ae2f1b1ea1-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Lock "cinder-82187819-c70f-4396-8763-55ae2f1b1ea1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Acquiring lock "cinder-quobyte-82187819-c70f-4396-8763-55ae2f1b1ea1" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Lock "cinder-quobyte-82187819-c70f-4396-8763-55ae2f1b1ea1" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3590560-357c-438a-ad72-3988f99a8594]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:54 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1
Apr 29 08:39:54 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:54 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-fdda1793-1d42-42ce-94ce-596293c1bbaa tempest-VolumesTransfersTest-63479597 None] Transfer volume completed successfully.
Apr 29 08:39:54 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480" returned: 0 in 0.702s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.561s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1373670202',display_name='tempest-VolumesGetTest-Volume-1426715798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a131c9c-2398-4d14-8bb8-a73794c145bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:51Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Creating volume 0a131c9c-2398-4d14-8bb8-a73794c145bb {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:54 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:54 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb 1073741824
Apr 29 08:39:54 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Attempting download of b7d8ee2a-d63e-4da9-983e-f810d728a919 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}])) to volume 79738d39-4464-40e2-8a36-01e08d133480. {{(pid=83885) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d560145a-5823-4310-9493-fcc2f6a4d2b7]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919__7s4ydya {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:54 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1" returned: 0 in 0.720s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:54 devstack sudo[89989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919__7s4ydya
Apr 29 08:39:54 devstack sudo[89990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1
Apr 29 08:39:54 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:54 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:55 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-82187819-c70f-4396-8763-55ae2f1b1ea1" returned: 0 in 0.695s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:55 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Lock "cinder-quobyte-82187819-c70f-4396-8763-55ae2f1b1ea1" released by "delete_volume" :: held 1.471s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919__7s4ydya" returned: 0 in 0.815s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919__7s4ydya {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Created reservations ['838a19d4-e6bf-49ae-acbe-17028f3acb49', '68cb45e5-bb4c-48b4-b6b7-86675d7dc589', '56d92dc8-85b6-4046-9c69-f3665c52da6f', '67152199-c7a5-41d3-ae21-ba7b256c7ff2'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:55 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb 1073741824" returned: 0 in 1.029s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:55 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919__7s4ydya
Apr 29 08:39:55 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:55 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:55 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Acquiring lock "cinder-332cb3de-a990-4169-8b9d-8896dc5837e8-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Lock "cinder-332cb3de-a990-4169-8b9d-8896dc5837e8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:55 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb
Apr 29 08:39:55 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Acquiring lock "cinder-quobyte-332cb3de-a990-4169-8b9d-8896dc5837e8" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Lock "cinder-quobyte-332cb3de-a990-4169-8b9d-8896dc5837e8" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9d795d-479a-415c-bd0b-0f98ed5ef87f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:55 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8
Apr 29 08:39:55 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:56 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919__7s4ydya" returned: 1 in 0.838s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919__7s4ydya' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d4c6dd-ca0c-4d58-aaaa-e6368f598dca]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:56 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.722s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Deleted volume successfully.
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-99444af2-3eb6-4685-9339-9a5b808d97bb tempest-VolumeQuotasAdminTestJSON-162505081 None] Lock "cinder-82187819-c70f-4396-8763-55ae2f1b1ea1-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:56 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD
Apr 29 08:39:56 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:56 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb" returned: 0 in 0.901s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcef07d5-ccf4-4cf1-98d4-cbe2150e707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a131c9c-2398-4d14-8bb8-a73794c145bb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af19881-d3f0-4c4a-b838-16efe3264be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:56 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Volume volume-0a131c9c-2398-4d14-8bb8-a73794c145bb (0a131c9c-2398-4d14-8bb8-a73794c145bb): created successfully
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af19881-d3f0-4c4a-b838-16efe3264be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (d0fa7606-d38d-407c-ab46-46c16b27ae4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-829255fb-b72b-4fbd-8358-298b35a5fc28 tempest-VolumesGetTest-1968490074 None] Created volume successfully.
Apr 29 08:39:56 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8" returned: 0 in 0.904s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:56 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8
Apr 29 08:39:56 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:57 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] b7d8ee2a-d63e-4da9-983e-f810d728a919 was qcow2, converting to raw {{(pid=83885) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:57 devstack sudo[90022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480
Apr 29 08:39:57 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:57 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-332cb3de-a990-4169-8b9d-8896dc5837e8" returned: 0 in 0.723s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Lock "cinder-quobyte-332cb3de-a990-4169-8b9d-8896dc5837e8" released by "delete_volume" :: held 1.695s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Created reservations ['6c45a8a6-2372-4b6c-9eab-d9f568fb749f', '238988bd-d100-4667-901c-b53601770a0d', 'bb85c5ce-7fba-4b34-8517-bbab68cdbd3e', 'e63284b6-d3fb-446b-8153-5b0d774db600'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-0a131c9c-2398-4d14-8bb8-a73794c145bb-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Lock "cinder-0a131c9c-2398-4d14-8bb8-a73794c145bb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-quobyte-0a131c9c-2398-4d14-8bb8-a73794c145bb" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:57 devstack sudo[90025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:39:57 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-0a131c9c-2398-4d14-8bb8-a73794c145bb" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[070f0e77-03e9-458f-829a-422879f28fd3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:58 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb
Apr 29 08:39:58 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:58 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.111s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:58 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:58 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Deleted volume successfully.
Apr 29 08:39:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-83deddd7-f44b-49c9-b78d-ce1442fa0cbd tempest-VolumesTransfersTest-1666562757 None] Lock "cinder-332cb3de-a990-4169-8b9d-8896dc5837e8-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:58 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb" returned: 0 in 1.076s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:58 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb
Apr 29 08:39:58 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Flow 'volume_create_manager' (54c0decc-5dd5-4816-88eb-af2a3edbd1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2f05f7-fb54-4f8e-864f-39a907dfbe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2f05f7-fb54-4f8e-864f-39a907dfbe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-700531226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c721b254-96fc-4c4f-a080-dd7a9c2509c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3461d915da3461cbad341c40729d885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:59Z,use_quota=True,user_id='5ba324aed2cb4e5fb562edd7d7129450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f01abc-9a9b-4435-8264-dc7cb258ea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f01abc-9a9b-4435-8264-dc7cb258ea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6391fb2b-bdf9-43cf-8c33-727ae372d4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6391fb2b-bdf9-43cf-8c33-727ae372d4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c721b254-96fc-4c4f-a080-dd7a9c2509c0', 'volume_name': 'volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ac35fe-a6c6-4ce1-b143-7548fd4e9535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ac35fe-a6c6-4ce1-b143-7548fd4e9535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f25c10f-ac56-4ddb-af57-541ad1b20b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:59 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Volume c721b254-96fc-4c4f-a080-dd7a9c2509c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0', 'volume_size': 1}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-700531226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c721b254-96fc-4c4f-a080-dd7a9c2509c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3461d915da3461cbad341c40729d885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:59Z,use_quota=True,user_id='5ba324aed2cb4e5fb562edd7d7129450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Creating volume c721b254-96fc-4c4f-a080-dd7a9c2509c0 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:59 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:59 devstack sudo[90041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0 1073741824
Apr 29 08:39:59 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:59 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-0a131c9c-2398-4d14-8bb8-a73794c145bb" returned: 0 in 0.789s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-0a131c9c-2398-4d14-8bb8-a73794c145bb" released by "delete_volume" :: held 1.925s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Created reservations ['2a09b0c4-3a3a-437a-83bc-ebc261f4a7b5', 'ccf093bc-4c9b-4819-ba88-d29847cd77f1', '2890cda6-a347-4dba-bac5-d12199fbce87', '0a727423-f677-4bd5-82aa-a365db8c432e'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:59 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480" returned: 0 in 2.691s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_a9udekrvdevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:39:59 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Converted 112.00 MB image at 41.59 MB/s
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:59 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 1G
Apr 29 08:39:59 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:00 devstack sudo[90049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:00 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-65381724-e167-4590-837e-5bcafa3415ca-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Lock "cinder-65381724-e167-4590-837e-5bcafa3415ca-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-quobyte-65381724-e167-4590-837e-5bcafa3415ca" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-65381724-e167-4590-837e-5bcafa3415ca" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[738a9aac-5f4a-4450-9fed-bad79b60caed]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:00 devstack sudo[90053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca
Apr 29 08:40:00 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:00 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0 1073741824" returned: 0 in 1.250s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:00 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0
Apr 29 08:40:00 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:00 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 1G" returned: 0 in 0.969s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[010849db-0d0b-46b0-86ad-9e16ce03b18b]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:00 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.990s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:00 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:00 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Deleted volume successfully.
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-364a8d1e-98a3-4277-b1c9-99182e72a812 tempest-VolumesGetTest-1968490074 None] Lock "cinder-0a131c9c-2398-4d14-8bb8-a73794c145bb-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:01 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480
Apr 29 08:40:01 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:01 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0" returned: 0 in 0.762s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f25c10f-ac56-4ddb-af57-541ad1b20b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02625ef-f3c0-4bac-8709-a28c78e74eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:01 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Volume volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0 (c721b254-96fc-4c4f-a080-dd7a9c2509c0): created successfully
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02625ef-f3c0-4bac-8709-a28c78e74eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Flow 'volume_create_manager' (54c0decc-5dd5-4816-88eb-af2a3edbd1b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-aae671b5-0430-4913-b269-94bcf2fba3ed tempest-VolumesTransfersTest-1690854591 None] Created volume successfully.
Apr 29 08:40:01 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca" returned: 0 in 1.144s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:01 devstack sudo[90069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca
Apr 29 08:40:01 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:01 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480" returned: 0 in 0.889s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:01 devstack sudo[90073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480
Apr 29 08:40:01 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:02 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-65381724-e167-4590-837e-5bcafa3415ca" returned: 0 in 0.720s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-65381724-e167-4590-837e-5bcafa3415ca" released by "delete_volume" :: held 1.926s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Created reservations ['0e9fee59-84b4-4d78-86d4-ee768eaa7e1a', 'e2c642c9-f9a7-4718-861d-520c5b6e778a', '660182ac-1cd5-4628-96c0-0116d1553aa4', '607a9bab-0476-4338-86d1-af2e490c3fd4'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:02 devstack sudo[90076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:02 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-30999c64-cd2f-48d1-9d02-4c852fc1c363-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Lock "cinder-30999c64-cd2f-48d1-9d02-4c852fc1c363-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-quobyte-30999c64-cd2f-48d1-9d02-4c852fc1c363" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-30999c64-cd2f-48d1-9d02-4c852fc1c363" acquired by "delete_volume" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Acquiring lock "cinder-c721b254-96fc-4c4f-a080-dd7a9c2509c0-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1c6063-4730-4ef8-9fdf-385350572a10]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Lock "cinder-c721b254-96fc-4c4f-a080-dd7a9c2509c0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Acquiring lock "cinder-quobyte-c721b254-96fc-4c4f-a080-dd7a9c2509c0" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Lock "cinder-quobyte-c721b254-96fc-4c4f-a080-dd7a9c2509c0" acquired by "delete_volume" :: waited 0.040s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bc6977-10a3-4d41-b45f-fdb61e85896f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:03 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363
Apr 29 08:40:03 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:03 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480" returned: 1 in 1.238s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Downloaded image b7d8ee2a-d63e-4da9-983e-f810d728a919 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}])) to volume 79738d39-4464-40e2-8a36-01e08d133480 successfully. {{(pid=83885) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Temporary image b7d8ee2a-d63e-4da9-983e-f810d728a919 for user 5a58e4e8577445b5ab6df1ce0a19a857 is deleted. {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Marking volume 79738d39-4464-40e2-8a36-01e08d133480 as bootable. {{(pid=83885) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Copying metadata from image b7d8ee2a-d63e-4da9-983e-f810d728a919 to 79738d39-4464-40e2-8a36-01e08d133480. {{(pid=83885) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Creating volume glance metadata for volume 79738d39-4464-40e2-8a36-01e08d133480 backed by image b7d8ee2a-d63e-4da9-983e-f810d728a919 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83885) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 08:40:03 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0
Apr 29 08:40:03 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:03 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.854s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:03 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Deleted volume successfully.
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0893f9b3-97e5-4753-8cba-8f5a452b0693 tempest-VolumesGetTest-1968490074 None] Lock "cinder-65381724-e167-4590-837e-5bcafa3415ca-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98eb148-14c2-400b-9df4-880a3c45648d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79738d39-4464-40e2-8a36-01e08d133480', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e4cacf0>}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c050ea7a-f0ec-4b6d-b596-3b63cd445565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:03 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Volume volume-79738d39-4464-40e2-8a36-01e08d133480 (79738d39-4464-40e2-8a36-01e08d133480): created successfully
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c050ea7a-f0ec-4b6d-b596-3b63cd445565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Flow 'volume_create_manager' (2b9174f3-8e3f-4d18-8f11-3839598bf1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:03 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-dd96727f-3ac5-4af6-9986-b3e544827f2a tempest-VolumesExtendTest-1673452711 None] Created volume successfully.
Apr 29 08:40:03 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0" returned: 0 in 0.803s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:03 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363" returned: 0 in 1.012s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:03 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0
Apr 29 08:40:03 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:03 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363
Apr 29 08:40:03 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54180c9-6878-406c-bf83-04d508912dd7]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:04 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480
Apr 29 08:40:04 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:04 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:04 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c721b254-96fc-4c4f-a080-dd7a9c2509c0" returned: 0 in 0.769s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-30999c64-cd2f-48d1-9d02-4c852fc1c363" returned: 0 in 0.746s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Lock "cinder-quobyte-c721b254-96fc-4c4f-a080-dd7a9c2509c0" released by "delete_volume" :: held 1.647s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-30999c64-cd2f-48d1-9d02-4c852fc1c363" released by "delete_volume" :: held 1.926s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Created reservations ['489eda74-8a40-4084-9ea1-0f0ccfe78e13', 'e4ee1836-23a3-4151-b4d4-0b8ebc95fded', '54526a95-a530-4b21-920c-89f4d423c240', '904f6bb3-1bc8-4cc0-9b60-c59e05219fb9'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Created reservations ['8300cba7-dbe4-4e87-9db1-6f67d944673a', 'dc549f5c-5989-4771-932f-4a1f18f6f805', 'f4b795ca-c26b-4b06-9e3d-d922f6d4d29f', 'ac4b56b8-6606-4507-94ce-dad8f513cb1c'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:04 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:04 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:04 devstack sudo[90102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:04 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:05 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480" returned: 0 in 0.978s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:05 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480
Apr 29 08:40:05 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:05 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.890s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:05 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Deleted volume successfully.
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0f58c107-3c4c-450e-b231-742194a2dae7 tempest-VolumesGetTest-1968490074 None] Lock "cinder-30999c64-cd2f-48d1-9d02-4c852fc1c363-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (72d779a1-d7e4-4662-86ca-34dacb73451f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:05 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3e45a0-e47b-4253-b5c8-53820afbccb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.119s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3e45a0-e47b-4253-b5c8-53820afbccb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-455131088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4c3a2a-2e59-4834-8ce6-da062c88790c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:06Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494d4a2e-ac9c-4807-bcbf-559339bf4d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494d4a2e-ac9c-4807-bcbf-559339bf4d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e56b6a-60e7-4818-ac35-41f490aea9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.image.glance [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Creating Keystone auth plugin from conf {{(pid=83885) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 08:40:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Deleted volume successfully.
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-15823634-4c4e-4699-b20c-07eb2e3cd639 tempest-VolumesTransfersTest-1666562757 None] Lock "cinder-c721b254-96fc-4c4f-a080-dd7a9c2509c0-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:06 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480" returned: 1 in 1.199s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 2G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e56b6a-60e7-4818-ac35-41f490aea9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab4c3a2a-2e59-4834-8ce6-da062c88790c', 'volume_name': 'volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e6b6240>}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b617f5fd-d0ad-494a-aa1d-f731fa17f04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b617f5fd-d0ad-494a-aa1d-f731fa17f04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8fb711b-043b-40df-b83a-b3542e629022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:06 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Volume ab4c3a2a-2e59-4834-8ce6-da062c88790c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e6b6240>}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Trying to clone ab4c3a2a-2e59-4834-8ce6-da062c88790c from image b7d8ee2a-d63e-4da9-983e-f810d728a919 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]). {{(pid=83885) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 2G" returned: 0 in 0.149s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.390s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-118d7dfb-6542-4380-9c0a-942192baa2a7 tempest-VolumesExtendTest-1673452711 None] Extend volume completed successfully.
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Flow 'volume_create_manager' (27b82b53-9372-4c3e-b1d4-c2f894027b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5752d9e-053d-4f26-99bb-20198a6d92b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5752d9e-053d-4f26-99bb-20198a6d92b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-625740373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa04b605-a23d-41fe-8ff1-2cbbc5245378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f7e4657f174af7a7bd99a1777d7755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:07Z,use_quota=True,user_id='3aa4fe0dbdb741e08378d21477d41c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07355c92-bfde-4f53-9c3a-aa0b131841b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07355c92-bfde-4f53-9c3a-aa0b131841b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff97fc8-dd5b-4a74-8f27-6fc20847c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff97fc8-dd5b-4a74-8f27-6fc20847c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa04b605-a23d-41fe-8ff1-2cbbc5245378', 'volume_name': 'volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af069d2b-86d3-4354-a89a-9e6ae858e1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af069d2b-86d3-4354-a89a-9e6ae858e1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b62a4-eb3c-4514-975f-accf018ac231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:06 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Volume aa04b605-a23d-41fe-8ff1-2cbbc5245378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378', 'volume_size': 1}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-625740373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa04b605-a23d-41fe-8ff1-2cbbc5245378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f7e4657f174af7a7bd99a1777d7755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:07Z,use_quota=True,user_id='3aa4fe0dbdb741e08378d21477d41c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Creating volume aa04b605-a23d-41fe-8ff1-2cbbc5245378 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:06 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:06 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378 1073741824
Apr 29 08:40:06 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Acquiring lock "cinder-79738d39-4464-40e2-8a36-01e08d133480-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Lock "cinder-79738d39-4464-40e2-8a36-01e08d133480-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Acquiring lock "cinder-quobyte-79738d39-4464-40e2-8a36-01e08d133480" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Lock "cinder-quobyte-79738d39-4464-40e2-8a36-01e08d133480" acquired by "delete_volume" :: waited 0.030s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 08:40:07 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c675ab8d-3558-43ad-ba11-0e41aa2570c2]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a8f2c7-b29c-42f4-9a22-9c1c2af845f1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:07 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480
Apr 29 08:40:07 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:07 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD
Apr 29 08:40:07 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:07 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378 1073741824" returned: 0 in 0.990s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:08 devstack sudo[90127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378
Apr 29 08:40:08 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:08 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480" returned: 0 in 0.999s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:08 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD" returned: 0 in 1.002s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Temporary image b7d8ee2a-d63e-4da9-983e-f810d728a919 is fetched for user 7679338e3803446f8ecccdae5acbdd81. {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 08:40:08 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480
Apr 29 08:40:08 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[99695b2a-8f8f-4e86-ac91-5073651ef131]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:08 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD
Apr 29 08:40:08 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:08 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378" returned: 0 in 0.820s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b62a4-eb3c-4514-975f-accf018ac231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8202e575-b969-4c86-9fe1-5f606c9c37d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:08 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Volume volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378 (aa04b605-a23d-41fe-8ff1-2cbbc5245378): created successfully
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8202e575-b969-4c86-9fe1-5f606c9c37d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Flow 'volume_create_manager' (27b82b53-9372-4c3e-b1d4-c2f894027b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:08 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e2c4c35a-65c3-4d5f-9e0a-29caf771a34f tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Created volume successfully.
Apr 29 08:40:09 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480" returned: 1 in 0.862s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:09 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480
Apr 29 08:40:09 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:09 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD" returned: 0 in 0.937s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-455131088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4c3a2a-2e59-4834-8ce6-da062c88790c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:06Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Creating volume ab4c3a2a-2e59-4834-8ce6-da062c88790c {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:09 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:09 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c 1073741824
Apr 29 08:40:09 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:09 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-79738d39-4464-40e2-8a36-01e08d133480" returned: 0 in 0.888s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Lock "cinder-quobyte-79738d39-4464-40e2-8a36-01e08d133480" released by "delete_volume" :: held 2.843s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:10 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Created reservations ['ef715b6f-3f35-40cc-8543-1ebbc1daef82', '003d8858-5df8-4daa-8a61-3eb4348303c3', 'f5329e50-96f4-47ee-975d-ae0af8d45a8d', '5013a565-2abd-49fb-b90f-a9275c86e19c'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:10 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:10 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:10 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c 1073741824" returned: 0 in 1.152s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:10 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c
Apr 29 08:40:10 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Flow 'volume_create_manager' (964c568d-959f-45b4-9aaa-4ee2724f02e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caac5ec0-a385-4bf4-8a85-b081bb9fd7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caac5ec0-a385-4bf4-8a85-b081bb9fd7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-22701253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e867aa22-3b7d-4be7-a889-6601b2840f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5e490fe0214d259ea5bd0b323cb92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:11Z,use_quota=True,user_id='5a58e4e8577445b5ab6df1ce0a19a857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0434176-4461-4f62-9124-b00c398eb5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0434176-4461-4f62-9124-b00c398eb5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c22683-e13f-4e53-9f10-cf139a5ee777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c22683-e13f-4e53-9f10-cf139a5ee777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e867aa22-3b7d-4be7-a889-6601b2840f90', 'volume_name': 'volume-e867aa22-3b7d-4be7-a889-6601b2840f90', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96dd841b-96cc-4ede-a041-2d93e7003355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96dd841b-96cc-4ede-a041-2d93e7003355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afa0ca4-ccd9-47be-9bc3-d809a2ee95d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Volume e867aa22-3b7d-4be7-a889-6601b2840f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e867aa22-3b7d-4be7-a889-6601b2840f90', 'volume_size': 1}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:11 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.152s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:11 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Deleted volume successfully.
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c8a4c2bd-7b15-43dd-bb0c-61874f42d33d tempest-VolumesExtendTest-1673452711 None] Lock "cinder-79738d39-4464-40e2-8a36-01e08d133480-delete_volume" released by "delete_volume" :: held 4.305s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Acquiring lock "cinder-aa04b605-a23d-41fe-8ff1-2cbbc5245378-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "cinder-aa04b605-a23d-41fe-8ff1-2cbbc5245378-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:11 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c" returned: 0 in 0.981s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.241s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-22701253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e867aa22-3b7d-4be7-a889-6601b2840f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5e490fe0214d259ea5bd0b323cb92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:11Z,use_quota=True,user_id='5a58e4e8577445b5ab6df1ce0a19a857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Creating volume e867aa22-3b7d-4be7-a889-6601b2840f90 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:11 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Acquiring lock "cinder-quobyte-aa04b605-a23d-41fe-8ff1-2cbbc5245378" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:11 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90 1073741824
Apr 29 08:40:11 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "cinder-quobyte-aa04b605-a23d-41fe-8ff1-2cbbc5245378" acquired by "delete_volume" :: waited 0.043s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Attempting download of b7d8ee2a-d63e-4da9-983e-f810d728a919 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}])) to volume ab4c3a2a-2e59-4834-8ce6-da062c88790c. {{(pid=83885) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f174c5b7-72c1-4f97-972c-4e5c53d1ff09]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[34926f2f-d6b8-4a5b-b3c3-9806f99c238e]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_aif5yn8o {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:11 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378
Apr 29 08:40:11 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:11 devstack sudo[90165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_aif5yn8o
Apr 29 08:40:11 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:12 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:12 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_aif5yn8o" returned: 0 in 0.812s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_aif5yn8o {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90 1073741824" returned: 0 in 0.978s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:12 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378" returned: 0 in 0.956s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:12 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90
Apr 29 08:40:12 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:12 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378
Apr 29 08:40:12 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:12 devstack sudo[90178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_aif5yn8o
Apr 29 08:40:12 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Flow 'volume_create_manager' (696d7809-3f87-4f45-90a9-246aa844ca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e48914a-b4b7-4ce6-80f0-fff2d900fdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e48914a-b4b7-4ce6-80f0-fff2d900fdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-887232188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016b7eb8-72ec-4639-9257-8d88b7539b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c743339b01ab41d4b19f4f0be5a7f1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:13Z,use_quota=True,user_id='76ee0d711f964304a350ee168a163bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2caa0c-e4a8-4fa2-8a3b-6ece7c2c7f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2caa0c-e4a8-4fa2-8a3b-6ece7c2c7f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029168b7-5115-4166-802b-98cc427491eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029168b7-5115-4166-802b-98cc427491eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016b7eb8-72ec-4639-9257-8d88b7539b72', 'volume_name': 'volume-016b7eb8-72ec-4639-9257-8d88b7539b72', 'volume_size': 2}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb33ac25-6e49-497a-9459-ba38abcd152b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb33ac25-6e49-497a-9459-ba38abcd152b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65599531-8cb9-4b02-ba19-464fd6619f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Volume 016b7eb8-72ec-4639-9257-8d88b7539b72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016b7eb8-72ec-4639-9257-8d88b7539b72', 'volume_size': 2}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:13 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90" returned: 0 in 0.745s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-887232188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016b7eb8-72ec-4639-9257-8d88b7539b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c743339b01ab41d4b19f4f0be5a7f1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:13Z,use_quota=True,user_id='76ee0d711f964304a350ee168a163bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Creating volume 016b7eb8-72ec-4639-9257-8d88b7539b72 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:13 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72 2147483648 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afa0ca4-ccd9-47be-9bc3-d809a2ee95d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e867aa22-3b7d-4be7-a889-6601b2840f90', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72 2147483648
Apr 29 08:40:13 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa99ec3-58c4-4c8e-b836-3903997bbf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Volume volume-e867aa22-3b7d-4be7-a889-6601b2840f90 (e867aa22-3b7d-4be7-a889-6601b2840f90): created successfully
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa99ec3-58c4-4c8e-b836-3903997bbf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Flow 'volume_create_manager' (964c568d-959f-45b4-9aaa-4ee2724f02e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:13 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_aif5yn8o" returned: 1 in 0.902s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d8ee2a-d63e-4da9-983e-f810d728a919_aif5yn8o' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:40:13 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-124564ef-5da4-4e59-bc7f-cc591de49efc tempest-VolumesExtendTest-1673452711 None] Created volume successfully.
Apr 29 08:40:13 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9554d2-69eb-4bca-a1f1-cf2ea9b48dd9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-aa04b605-a23d-41fe-8ff1-2cbbc5245378" returned: 0 in 0.854s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "cinder-quobyte-aa04b605-a23d-41fe-8ff1-2cbbc5245378" released by "delete_volume" :: held 1.880s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Created reservations ['4c618800-a172-4912-ac5f-0cfc323c937c', '5955bdb7-33cb-4028-b020-cec3ce4492c8', '6031ec28-269b-4249-b408-e96cc2f0fef1', 'ee97f4aa-8a8a-4558-b524-eb8a63de8564'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:13 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD
Apr 29 08:40:13 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:13 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:13 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:14 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD" returned: 0 in 0.830s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:14 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] b7d8ee2a-d63e-4da9-983e-f810d728a919 was qcow2, converting to raw {{(pid=83885) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 08:40:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:14 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c
Apr 29 08:40:14 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:14 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72 2147483648" returned: 0 in 1.066s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:14 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.822s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:14 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:14 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Deleted volume successfully.
Apr 29 08:40:14 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72
Apr 29 08:40:14 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5cb0a2e2-2e3b-44ab-8395-8d4a6edf76b2 tempest-VolumeQuotasNegativeTestJSON-2056252600 None] Lock "cinder-aa04b605-a23d-41fe-8ff1-2cbbc5245378-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72" returned: 0 in 0.715s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:15 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.528s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Creating offline snapshot 286a874a-0283-443f-8c9b-dbfd64d199e1 of volume e867aa22-3b7d-4be7-a889-6601b2840f90 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65599531-8cb9-4b02-ba19-464fd6619f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016b7eb8-72ec-4639-9257-8d88b7539b72', 'volume_size': 2}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91749e1-e441-47be-afc1-57f9aa6dc2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[97320123-e068-48d7-85af-99e82ccb44d0]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:15 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Volume volume-016b7eb8-72ec-4639-9257-8d88b7539b72 (016b7eb8-72ec-4639-9257-8d88b7539b72): created successfully
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91749e1-e441-47be-afc1-57f9aa6dc2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:15 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Flow 'volume_create_manager' (696d7809-3f87-4f45-90a9-246aa844ca98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:15 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-90f5af92-1bf6-4399-8fe4-0744587cc49a tempest-VolumesCloneNegativeTest-156363592 None] Created volume successfully.
Apr 29 08:40:15 devstack sudo[90218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90
Apr 29 08:40:15 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:16 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90" returned: 0 in 0.827s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:16 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 1G
Apr 29 08:40:16 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Acquiring lock "cinder-016b7eb8-72ec-4639-9257-8d88b7539b72-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Lock "cinder-016b7eb8-72ec-4639-9257-8d88b7539b72-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Acquiring lock "cinder-quobyte-016b7eb8-72ec-4639-9257-8d88b7539b72" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Lock "cinder-quobyte-016b7eb8-72ec-4639-9257-8d88b7539b72" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5598b66-61ff-45f4-9cb3-85cf1968f1cd]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:16 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c" returned: 0 in 2.453s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7d8ee2a-d63e-4da9-983e-f810d728a919_b1m75gu_devstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:40:16 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Converted 112.00 MB image at 45.61 MB/s
Apr 29 08:40:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:16 devstack sudo[90229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c 1G
Apr 29 08:40:16 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:16 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72
Apr 29 08:40:16 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:17 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 1G" returned: 0 in 1.044s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e867aa22-3b7d-4be7-a889-6601b2840f90 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:17 devstack sudo[90233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e867aa22-3b7d-4be7-a889-6601b2840f90 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1
Apr 29 08:40:17 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:17 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72" returned: 0 in 0.824s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:17 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72
Apr 29 08:40:17 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:17 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c 1G" returned: 0 in 0.850s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:17 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[25703de4-fa27-4c2f-a726-a181fc3af2ef]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:17 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c
Apr 29 08:40:17 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:17 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e867aa22-3b7d-4be7-a889-6601b2840f90 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1" returned: 0 in 0.804s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:17 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 is being set with open permissions: ugo+rw
Apr 29 08:40:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:17 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1
Apr 29 08:40:17 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:18 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-016b7eb8-72ec-4639-9257-8d88b7539b72" returned: 0 in 0.734s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Lock "cinder-quobyte-016b7eb8-72ec-4639-9257-8d88b7539b72" released by "delete_volume" :: held 1.618s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=162,cinder:DELETE=15,cinder:SELECT=113,cinder:INSERT=55 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Created reservations ['c3702ea0-0e36-43e7-8764-c83888e061e4', '7c41f6d2-224e-444c-80c1-d57cd61276e9', '59a0ef4e-0761-4967-b1e0-562b535cb06c', '71c5248f-9396-4dbd-a177-5d65597141fb'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:18 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:18 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:18 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c" returned: 0 in 0.913s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:18 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c
Apr 29 08:40:18 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:18 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1" returned: 0 in 0.844s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:18 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.info
Apr 29 08:40:18 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:19 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.793s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Deleted volume successfully.
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-add3c8b1-3471-43a5-bbd6-816a2b48c110 tempest-VolumesCloneNegativeTest-156363592 None] Lock "cinder-016b7eb8-72ec-4639-9257-8d88b7539b72-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:19 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c" returned: 1 in 0.921s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Downloaded image b7d8ee2a-d63e-4da9-983e-f810d728a919 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}])) to volume ab4c3a2a-2e59-4834-8ce6-da062c88790c successfully. {{(pid=83885) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Temporary image b7d8ee2a-d63e-4da9-983e-f810d728a919 for user 7679338e3803446f8ecccdae5acbdd81 is deleted. {{(pid=83885) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.volume.volume_utils [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Marking volume ab4c3a2a-2e59-4834-8ce6-da062c88790c as bootable. {{(pid=83885) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Copying metadata from image b7d8ee2a-d63e-4da9-983e-f810d728a919 to ab4c3a2a-2e59-4834-8ce6-da062c88790c. {{(pid=83885) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Creating volume glance metadata for volume ab4c3a2a-2e59-4834-8ce6-da062c88790c backed by image b7d8ee2a-d63e-4da9-983e-f810d728a919 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83885) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 08:40:19 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.info" returned: 0 in 0.812s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:19 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.info is being set with open permissions: ugo+rw
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:19 devstack sudo[90265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.info
Apr 29 08:40:19 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8fb711b-043b-40df-b83a-b3542e629022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c', 'volume_size': 1, 'image_id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d8ee2a-d63e-4da9-983e-f810d728a919', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '567d4896975643a3bb7dc9a7d4318135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d8ee2a-d63e-4da9-983e-f810d728a919', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d8ee2a-d63e-4da9-983e-f810d728a919/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dcf2e6b6240>}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c5de2d-781c-442d-886f-fd7bea76310f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:19 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Volume volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c (ab4c3a2a-2e59-4834-8ce6-da062c88790c): created successfully
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c5de2d-781c-442d-886f-fd7bea76310f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (72d779a1-d7e4-4662-86ca-34dacb73451f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-85ec4d67-66cd-4685-b61d-fd25e269cfb9 tempest-VolumesGetTest-1968490074 None] Created volume successfully.
Apr 29 08:40:20 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.info" returned: 0 in 0.747s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.218s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:20 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3d5aec0e-ac9c-4801-ba75-90687e71773e tempest-VolumesExtendTest-1673452711 None] Create snapshot completed successfully
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Flow 'volume_create_manager' (770b92de-1c20-4816-b255-60c379e2c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c20790-e4e0-42cb-aeab-6d32cf796b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c20790-e4e0-42cb-aeab-6d32cf796b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1021264700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d245b642-afc2-4537-99df-380cbe4f1f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066d7eea2a704f03a45fb2723e32fbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:21Z,use_quota=True,user_id='ffca0e0143114593a3cd1833f3e5a9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(488a4248-ea76-4da2-a1a5-6895e481cae1),volume_type_id=488a4248-ea76-4da2-a1a5-6895e481cae1)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f6beb6-9e1f-4007-b11d-beee763be33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f6beb6-9e1f-4007-b11d-beee763be33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b954875d-de2d-4d34-85f2-acb55a54e940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b954875d-de2d-4d34-85f2-acb55a54e940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd245b642-afc2-4537-99df-380cbe4f1f3c', 'volume_name': 'volume-d245b642-afc2-4537-99df-380cbe4f1f3c', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132b71fc-46e6-4681-8261-b1df3c69cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132b71fc-46e6-4681-8261-b1df3c69cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12ef6dc-4e03-4083-bf1a-84c4f1a43215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:20 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Volume d245b642-afc2-4537-99df-380cbe4f1f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d245b642-afc2-4537-99df-380cbe4f1f3c', 'volume_size': 1}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1021264700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d245b642-afc2-4537-99df-380cbe4f1f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066d7eea2a704f03a45fb2723e32fbfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:21Z,use_quota=True,user_id='ffca0e0143114593a3cd1833f3e5a9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(488a4248-ea76-4da2-a1a5-6895e481cae1),volume_type_id=488a4248-ea76-4da2-a1a5-6895e481cae1)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Creating volume d245b642-afc2-4537-99df-380cbe4f1f3c {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:20 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:20 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c 1073741824
Apr 29 08:40:20 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-92ad2639-c110-48a8-a1e6-09b533cda68b tempest-VolumesExtendTest-1673452711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (e9187540-172d-4d4a-b57b-7e725c07e224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2862b32-455f-49b3-a8be-3144075af831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2862b32-455f-49b3-a8be-3144075af831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1482331684',display_name='tempest-VolumesGetTest-Volume-1581488608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8c959b-3138-49f9-9d41-bc3c55985954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:21Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ee7fb0-8fb5-4ff3-bc5e-077bcdded682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ee7fb0-8fb5-4ff3-bc5e-077bcdded682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e5dc3a-5dc4-4ad8-a6d7-da25b8616ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e5dc3a-5dc4-4ad8-a6d7-da25b8616ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a8c959b-3138-49f9-9d41-bc3c55985954', 'volume_name': 'volume-6a8c959b-3138-49f9-9d41-bc3c55985954', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10bc4eb6-2cca-490a-97d8-66d3b213de24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10bc4eb6-2cca-490a-97d8-66d3b213de24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4d7ac7-cc11-42ce-8f09-a566913f490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:21 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Volume 6a8c959b-3138-49f9-9d41-bc3c55985954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a8c959b-3138-49f9-9d41-bc3c55985954', 'volume_size': 1}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:21 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c 1073741824" returned: 0 in 1.036s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:21 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c
Apr 29 08:40:21 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:22 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c" returned: 0 in 0.623s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-92ad2639-c110-48a8-a1e6-09b533cda68b tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.397s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b674a2-8755-4ef8-a85e-adb7c54f24f5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-92ad2639-c110-48a8-a1e6-09b533cda68b tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12ef6dc-4e03-4083-bf1a-84c4f1a43215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d245b642-afc2-4537-99df-380cbe4f1f3c', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fd1f23-6635-41e1-b8a7-0f5d349595c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:22 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Volume volume-d245b642-afc2-4537-99df-380cbe4f1f3c (d245b642-afc2-4537-99df-380cbe4f1f3c): created successfully
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fd1f23-6635-41e1-b8a7-0f5d349595c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:22 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Flow 'volume_create_manager' (770b92de-1c20-4816-b255-60c379e2c984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:22 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-314c269e-9c53-425d-ba4c-91df7a2aab57 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Created volume successfully.
Apr 29 08:40:22 devstack sudo[90313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90
Apr 29 08:40:22 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-04d2f99a-ea2b-4079-89a2-bb6c9d803b0c tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-04d2f99a-ea2b-4079-89a2-bb6c9d803b0c tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-04d2f99a-ea2b-4079-89a2-bb6c9d803b0c tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-04d2f99a-ea2b-4079-89a2-bb6c9d803b0c tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-04d2f99a-ea2b-4079-89a2-bb6c9d803b0c tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-04d2f99a-ea2b-4079-89a2-bb6c9d803b0c tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:23 devstack sudo[90317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:23 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:23 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-92ad2639-c110-48a8-a1e6-09b533cda68b tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90" returned: 0 in 0.838s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-92ad2639-c110-48a8-a1e6-09b533cda68b tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 2G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-92ad2639-c110-48a8-a1e6-09b533cda68b tempest-VolumesExtendTest-1673452711 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 2G" returned: 0 in 0.156s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-92ad2639-c110-48a8-a1e6-09b533cda68b tempest-VolumesExtendTest-1673452711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.028s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.260s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1482331684',display_name='tempest-VolumesGetTest-Volume-1581488608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8c959b-3138-49f9-9d41-bc3c55985954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b92ee411e2413b870b1e0d7bd92662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:21Z,use_quota=True,user_id='7679338e3803446f8ecccdae5acbdd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Creating volume 6a8c959b-3138-49f9-9d41-bc3c55985954 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:23 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:23 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954 1073741824
Apr 29 08:40:23 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:23 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-92ad2639-c110-48a8-a1e6-09b533cda68b tempest-VolumesExtendTest-1673452711 None] Extend volume completed successfully.
Apr 29 08:40:23 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-04d2f99a-ea2b-4079-89a2-bb6c9d803b0c tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.689s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:23 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-04d2f99a-ea2b-4079-89a2-bb6c9d803b0c tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:23 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-04d2f99a-ea2b-4079-89a2-bb6c9d803b0c tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Retype volume completed successfully.
Apr 29 08:40:24 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Acquiring lock "cinder-d245b642-afc2-4537-99df-380cbe4f1f3c-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954 1073741824" returned: 0 in 0.929s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "cinder-d245b642-afc2-4537-99df-380cbe4f1f3c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:24 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954
Apr 29 08:40:24 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Acquiring lock "cinder-quobyte-d245b642-afc2-4537-99df-380cbe4f1f3c" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "cinder-quobyte-d245b642-afc2-4537-99df-380cbe4f1f3c" acquired by "delete_volume" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Acquiring lock "cinder-286a874a-0283-443f-8c9b-dbfd64d199e1-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[634309cc-110b-4107-aebe-6d9760c7b5df]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Lock "cinder-286a874a-0283-443f-8c9b-dbfd64d199e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Acquiring lock "cinder-quobyte-e867aa22-3b7d-4be7-a889-6601b2840f90" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Lock "cinder-quobyte-e867aa22-3b7d-4be7-a889-6601b2840f90" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Acquiring lock "cinder-quobyte-286a874a-0283-443f-8c9b-dbfd64d199e1" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Lock "cinder-quobyte-286a874a-0283-443f-8c9b-dbfd64d199e1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Deleting offline snapshot 286a874a-0283-443f-8c9b-dbfd64d199e1 of volume e867aa22-3b7d-4be7-a889-6601b2840f90 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] snapshot_file for this snap is: volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e1438-2e84-4a44-89e9-5cf0c3a78827]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:24 devstack sudo[90334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c
Apr 29 08:40:24 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:24 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1
Apr 29 08:40:24 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:25 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954" returned: 0 in 0.780s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Flow 'volume_create_manager' (31ea7bc7-e7c9-4b9b-935b-2bd4bb88011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23543cc0-37a2-4f57-b6f1-51f7c4965012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4d7ac7-cc11-42ce-8f09-a566913f490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a8c959b-3138-49f9-9d41-bc3c55985954', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d9e1fd-6dc9-47a5-a8dd-a748c202f793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23543cc0-37a2-4f57-b6f1-51f7c4965012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1511067704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de99b5ff-061d-4509-b4a7-40684230d68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80e571d9fd314fd4a88aff7c7b9e3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:25Z,use_quota=True,user_id='c3c84636f13848e49be378c7fe972d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f72d843-ab8f-4daf-8346-cd5cdaf7cae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f72d843-ab8f-4daf-8346-cd5cdaf7cae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb4cc0b-a5f8-4c39-8129-3aa2f558a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb4cc0b-a5f8-4c39-8129-3aa2f558a950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de99b5ff-061d-4509-b4a7-40684230d68c', 'volume_name': 'volume-de99b5ff-061d-4509-b4a7-40684230d68c', 'volume_size': 2}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5b6138-d1d7-414d-94bf-36e13187b195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5b6138-d1d7-414d-94bf-36e13187b195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85aad4a-61e2-497f-8a3c-2929ea932758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:25 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Volume de99b5ff-061d-4509-b4a7-40684230d68c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de99b5ff-061d-4509-b4a7-40684230d68c', 'volume_size': 2}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1511067704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de99b5ff-061d-4509-b4a7-40684230d68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80e571d9fd314fd4a88aff7c7b9e3d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:25Z,use_quota=True,user_id='c3c84636f13848e49be378c7fe972d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Creating volume de99b5ff-061d-4509-b4a7-40684230d68c {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:25 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c 2147483648 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:25 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Volume volume-6a8c959b-3138-49f9-9d41-bc3c55985954 (6a8c959b-3138-49f9-9d41-bc3c55985954): created successfully
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d9e1fd-6dc9-47a5-a8dd-a748c202f793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Flow 'volume_create_manager' (e9187540-172d-4d4a-b57b-7e725c07e224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:25 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c 2147483648
Apr 29 08:40:25 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-cdf0c2f0-77b7-4c3f-bfb5-377ba1167553 tempest-VolumesGetTest-1968490074 None] Created volume successfully.
Apr 29 08:40:25 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:25 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c" returned: 0 in 0.961s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:25 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c
Apr 29 08:40:25 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:25 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1" returned: 0 in 0.922s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e867aa22-3b7d-4be7-a889-6601b2840f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[61505054-8290-4553-bf83-4bdfcc8e005a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-6a8c959b-3138-49f9-9d41-bc3c55985954-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Lock "cinder-6a8c959b-3138-49f9-9d41-bc3c55985954-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-quobyte-6a8c959b-3138-49f9-9d41-bc3c55985954" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-6a8c959b-3138-49f9-9d41-bc3c55985954" acquired by "delete_volume" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e315ff-cfe5-47a7-8988-4a3464964f9c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:25 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90
Apr 29 08:40:25 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:26 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954
Apr 29 08:40:26 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:26 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d245b642-afc2-4537-99df-380cbe4f1f3c" returned: 0 in 0.770s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "cinder-quobyte-d245b642-afc2-4537-99df-380cbe4f1f3c" released by "delete_volume" :: held 1.806s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:26 devstack cinder-volume[83885]: WARNING cinder.quota [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:40:26 devstack cinder-volume[83885]: WARNING cinder.quota [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Created reservations ['ae71fd5a-9a55-47bd-b561-792efe54240b', 'd9eeebfd-b705-4735-9e7c-0ae0c062ca3b', 'eae4a4d5-fa04-43b4-9c3d-7ab00bda6c93', '855d2044-ba03-4ab1-bbee-05882ed40baf'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:26 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c 2147483648" returned: 0 in 1.101s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:26 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:26 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:26 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c
Apr 29 08:40:26 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:26 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90" returned: 0 in 1.137s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:26 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954" returned: 0 in 1.010s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:26 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1
Apr 29 08:40:26 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954
Apr 29 08:40:26 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:26 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:27 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.853s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:27 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Deleted volume successfully.
Apr 29 08:40:27 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c" returned: 0 in 0.864s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-52ae853b-7ea3-43a9-9fa0-1ceebe95d6b4 tempest-VolumeRetypeWithoutMigrationTest-2119576240 None] Lock "cinder-d245b642-afc2-4537-99df-380cbe4f1f3c-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85aad4a-61e2-497f-8a3c-2929ea932758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de99b5ff-061d-4509-b4a7-40684230d68c', 'volume_size': 2}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50a9b61-bb20-4c99-a722-374d7850b7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:27 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Volume volume-de99b5ff-061d-4509-b4a7-40684230d68c (de99b5ff-061d-4509-b4a7-40684230d68c): created successfully
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50a9b61-bb20-4c99-a722-374d7850b7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Flow 'volume_create_manager' (31ea7bc7-e7c9-4b9b-935b-2bd4bb88011d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:27 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-43124f8f-caf7-4e38-9bed-dffa12f92ce1 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Created volume successfully.
Apr 29 08:40:27 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6a8c959b-3138-49f9-9d41-bc3c55985954" returned: 0 in 0.831s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-6a8c959b-3138-49f9-9d41-bc3c55985954" released by "delete_volume" :: held 1.892s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Created reservations ['20533203-b18f-4835-8280-5c7bffbc61ca', 'bba392af-226c-498f-a41e-829e2f669a5b', 'e1523935-8663-4e54-ae7c-c936b203d4d6', 'be1a034a-4564-41dd-84d5-d0408c917f4c'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=175,cinder:SELECT=145,cinder:INSERT=44,cinder:DELETE=13 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:27 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:27 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:27 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1" returned: 0 in 1.068s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:28 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1
Apr 29 08:40:28 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-ab4c3a2a-2e59-4834-8ce6-da062c88790c-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Lock "cinder-ab4c3a2a-2e59-4834-8ce6-da062c88790c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Acquiring lock "cinder-quobyte-ab4c3a2a-2e59-4834-8ce6-da062c88790c" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-ab4c3a2a-2e59-4834-8ce6-da062c88790c" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6a41d-06b9-49c4-be2a-5f3228d763bb]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:28 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c
Apr 29 08:40:28 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:28 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.852s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:28 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Deleted volume successfully.
Apr 29 08:40:28 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90.286a874a-0283-443f-8c9b-dbfd64d199e1" returned: 0 in 0.851s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1ae4c63-f9ce-4d4e-8559-4c5d443b104d tempest-VolumesGetTest-1968490074 None] Lock "cinder-6a8c959b-3138-49f9-9d41-bc3c55985954-delete_volume" released by "delete_volume" :: held 3.021s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Lock "cinder-quobyte-286a874a-0283-443f-8c9b-dbfd64d199e1" released by "_delete_snapshot" :: held 4.151s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Lock "cinder-quobyte-e867aa22-3b7d-4be7-a889-6601b2840f90" released by "delete_snapshot" :: held 4.187s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Creating offline snapshot d0767125-7d04-43ec-a101-22b544925757 of volume de99b5ff-061d-4509-b4a7-40684230d68c {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:40:29 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[357383a3-1974-426d-9d5c-a19c87efe39c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:29 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Created reservations ['3693d9e5-4660-4ac4-b55b-614e0228d45e', '830a0168-db89-46cb-a60e-9b7da219c50f', '6fdd5c56-e711-4b17-9eb2-6d33891992fb', '5e92a6d4-4f1c-43e5-951f-3917cb9dc85b'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Delete snapshot completed successfully.
Apr 29 08:40:29 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-beb1f58b-ea24-4152-b7a9-d60640ff1c1e tempest-VolumesExtendTest-1673452711 None] Lock "cinder-286a874a-0283-443f-8c9b-dbfd64d199e1-delete_snapshot" released by "delete_snapshot" :: held 4.413s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:29 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c
Apr 29 08:40:29 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:29 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c" returned: 0 in 0.970s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:29 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c
Apr 29 08:40:29 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:29 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c" returned: 0 in 0.845s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 2G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:29 devstack sudo[90399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 2G
Apr 29 08:40:29 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Acquiring lock "cinder-e867aa22-3b7d-4be7-a889-6601b2840f90-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Lock "cinder-e867aa22-3b7d-4be7-a889-6601b2840f90-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:30 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c" returned: 1 in 0.855s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:30 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c
Apr 29 08:40:30 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Acquiring lock "cinder-quobyte-e867aa22-3b7d-4be7-a889-6601b2840f90" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Lock "cinder-quobyte-e867aa22-3b7d-4be7-a889-6601b2840f90" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe5da91-0978-435a-b910-2e2c4871e718]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:30 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90
Apr 29 08:40:30 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:30 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 2G" returned: 0 in 0.973s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de99b5ff-061d-4509-b4a7-40684230d68c -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:30 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de99b5ff-061d-4509-b4a7-40684230d68c -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757
Apr 29 08:40:30 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:30 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-ab4c3a2a-2e59-4834-8ce6-da062c88790c" returned: 0 in 0.738s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Lock "cinder-quobyte-ab4c3a2a-2e59-4834-8ce6-da062c88790c" released by "delete_volume" :: held 2.680s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Created reservations ['6b0f4a46-8e4a-4713-8bdb-02c8854e21a1', '730f8f05-181b-4710-b3d4-78931aba52ef', '79ae220f-5be6-4e62-a0dc-922b34a7b44e', '3a40ee39-beec-416b-b387-394c2359cec1'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:31 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90" returned: 0 in 0.847s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:31 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:31 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:31 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90
Apr 29 08:40:31 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:31 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de99b5ff-061d-4509-b4a7-40684230d68c -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757" returned: 0 in 0.921s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:31 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 is being set with open permissions: ugo+rw
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:31 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757
Apr 29 08:40:31 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:31 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.713s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:31 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Deleted volume successfully.
Apr 29 08:40:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-9694bb43-b478-4452-a4f5-b6d3d17ff534 tempest-VolumesGetTest-1968490074 None] Lock "cinder-ab4c3a2a-2e59-4834-8ce6-da062c88790c-delete_volume" released by "delete_volume" :: held 3.746s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:32 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e867aa22-3b7d-4be7-a889-6601b2840f90" returned: 0 in 0.886s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Lock "cinder-quobyte-e867aa22-3b7d-4be7-a889-6601b2840f90" released by "delete_volume" :: held 1.815s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Created reservations ['05edf897-1aee-4ff4-83eb-b10177085b05', '7cf7a6d4-1126-4113-a345-b503721ee6ab', 'c14a4431-8861-42c0-b9ae-067e14c9b95b', '7ee72297-5f91-4de8-9f5c-d1aa0b47ded0'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:32 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:32 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:32 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757" returned: 0 in 0.790s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:32 devstack sudo[90440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.info
Apr 29 08:40:32 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:33 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.961s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:33 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:33 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Deleted volume successfully.
Apr 29 08:40:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4996fef-4a9e-46d8-8546-9d8ef4b56cd1 tempest-VolumesExtendTest-1673452711 None] Lock "cinder-e867aa22-3b7d-4be7-a889-6601b2840f90-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:33 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.info" returned: 0 in 0.942s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:33 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.info is being set with open permissions: ugo+rw
Apr 29 08:40:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:33 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.info
Apr 29 08:40:33 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:34 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.info" returned: 0 in 0.819s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.433s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:34 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-55191dff-0372-413b-bd66-199faffc7d74 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Create snapshot completed successfully
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Flow 'volume_create_manager' (e935426d-382b-485c-88bb-da73c1ecb037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081d99ca-17ea-47ba-8997-689080a24c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081d99ca-17ea-47ba-8997-689080a24c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1637740446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e287e1d-d2df-43c2-92f4-6c59138f0a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab00db70fecf4915a7b87b3395a074ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:35Z,use_quota=True,user_id='c5aebcda989143c0884fa215104cec19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0caab2dc-1158-461c-a2d5-cd2466410806),volume_type_id=0caab2dc-1158-461c-a2d5-cd2466410806)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129e6f65-567a-4c55-9f03-7a0ef690bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129e6f65-567a-4c55-9f03-7a0ef690bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9e850e-6349-4e3a-b368-1ae7842943a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9e850e-6349-4e3a-b368-1ae7842943a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e287e1d-d2df-43c2-92f4-6c59138f0a0f', 'volume_name': 'volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d18c346-e6cb-4be2-88fa-acbcd659ebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d18c346-e6cb-4be2-88fa-acbcd659ebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc59dee-3d27-4a1b-8553-6ee01b1978b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Volume 4e287e1d-d2df-43c2-92f4-6c59138f0a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f', 'volume_size': 1}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1637740446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e287e1d-d2df-43c2-92f4-6c59138f0a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab00db70fecf4915a7b87b3395a074ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:35Z,use_quota=True,user_id='c5aebcda989143c0884fa215104cec19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0caab2dc-1158-461c-a2d5-cd2466410806),volume_type_id=0caab2dc-1158-461c-a2d5-cd2466410806)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Creating volume 4e287e1d-d2df-43c2-92f4-6c59138f0a0f {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:35 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:35 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f 1073741824
Apr 29 08:40:35 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Acquiring lock "cinder-d0767125-7d04-43ec-a101-22b544925757-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-d0767125-7d04-43ec-a101-22b544925757-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Acquiring lock "cinder-quobyte-de99b5ff-061d-4509-b4a7-40684230d68c" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-quobyte-de99b5ff-061d-4509-b4a7-40684230d68c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Acquiring lock "cinder-quobyte-d0767125-7d04-43ec-a101-22b544925757" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-quobyte-d0767125-7d04-43ec-a101-22b544925757" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Deleting offline snapshot d0767125-7d04-43ec-a101-22b544925757 of volume de99b5ff-061d-4509-b4a7-40684230d68c {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] snapshot_file for this snap is: volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[88510c71-b733-4888-9fb6-46f635c11b87]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:35 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757
Apr 29 08:40:35 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Flow 'volume_create_manager' (386a6147-6b05-490a-888c-42b108bde871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cac5c9-4fc4-4d2d-86bd-4bafa1ceecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cac5c9-4fc4-4d2d-86bd-4bafa1ceecaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-126709460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c2fa54-5c8b-4bbd-a52a-5c53281e6964,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25527987f8744086b1f55a4d88af90c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:36Z,use_quota=True,user_id='463c898d402e4f35a89fba34c3d59226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3bd07a-61e2-40b7-aa8d-e628ab3ebd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3bd07a-61e2-40b7-aa8d-e628ab3ebd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d275c6c6-a681-418f-ab18-03e518df4d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d275c6c6-a681-418f-ab18-03e518df4d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c2fa54-5c8b-4bbd-a52a-5c53281e6964', 'volume_name': 'volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d130575e-5d9b-495a-8ee3-705d6aa9089a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d130575e-5d9b-495a-8ee3-705d6aa9089a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da4f029-7abb-4cde-9626-9d38960a9c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:35 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Volume e3c2fa54-5c8b-4bbd-a52a-5c53281e6964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964', 'volume_size': 1}
Apr 29 08:40:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:36 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f 1073741824" returned: 0 in 1.024s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:36 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757" returned: 0 in 0.845s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de99b5ff-061d-4509-b4a7-40684230d68c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b09e45-396a-41c7-bd09-accc590875fe]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:36 devstack sudo[90458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f
Apr 29 08:40:36 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:36 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c
Apr 29 08:40:36 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Flow 'volume_create_manager' (77365140-ad77-4175-aca7-97a80c39068a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59580cb-a34c-4b0d-b64f-d637f43ce6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59580cb-a34c-4b0d-b64f-d637f43ce6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2093408136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6639bc9-3527-4e14-a607-bf5b8bed7cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731917d3e8a346bab1e417bd551968a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:37Z,use_quota=True,user_id='64798973d9c243cebb41b8f04006ad10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85f1388-2b8f-4722-834a-172c5586b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85f1388-2b8f-4722-834a-172c5586b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5258a0-d5e9-4da7-a3cc-213b1bf78524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5258a0-d5e9-4da7-a3cc-213b1bf78524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6639bc9-3527-4e14-a607-bf5b8bed7cae', 'volume_name': 'volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f660b7-f854-45f5-946c-6f32c9b61241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f660b7-f854-45f5-946c-6f32c9b61241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06ef419-2682-4126-a765-234909dbccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:36 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Volume e6639bc9-3527-4e14-a607-bf5b8bed7cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae', 'volume_size': 1}
Apr 29 08:40:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:37 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f" returned: 0 in 0.654s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.180s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-126709460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c2fa54-5c8b-4bbd-a52a-5c53281e6964,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25527987f8744086b1f55a4d88af90c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:36Z,use_quota=True,user_id='463c898d402e4f35a89fba34c3d59226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Creating volume e3c2fa54-5c8b-4bbd-a52a-5c53281e6964 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:37 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:37 devstack sudo[90466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964 1073741824
Apr 29 08:40:37 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc59dee-3d27-4a1b-8553-6ee01b1978b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992b7b94-006e-45e4-9d1f-d3f06d34b603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:37 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Volume volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f (4e287e1d-d2df-43c2-92f4-6c59138f0a0f): created successfully
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992b7b94-006e-45e4-9d1f-d3f06d34b603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Flow 'volume_create_manager' (e935426d-382b-485c-88bb-da73c1ecb037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:37 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a0a4b156-9d30-4366-b75f-df664d2ac01d tempest-VolumeTypesAccessTest-1503254802 None] Created volume successfully.
Apr 29 08:40:37 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c" returned: 0 in 0.766s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:37 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757
Apr 29 08:40:37 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Acquiring lock "cinder-4e287e1d-d2df-43c2-92f4-6c59138f0a0f-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Lock "cinder-4e287e1d-d2df-43c2-92f4-6c59138f0a0f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Acquiring lock "cinder-quobyte-4e287e1d-d2df-43c2-92f4-6c59138f0a0f" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Lock "cinder-quobyte-4e287e1d-d2df-43c2-92f4-6c59138f0a0f" acquired by "delete_volume" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[8429c87f-855e-48f6-89b0-eebc4355252b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:37 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f
Apr 29 08:40:37 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:37 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757" returned: 0 in 0.755s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:37 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964 1073741824" returned: 0 in 0.886s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:37 devstack sudo[90479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757
Apr 29 08:40:37 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:38 devstack sudo[90481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964
Apr 29 08:40:38 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:38 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f" returned: 0 in 0.799s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:38 devstack sudo[90486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f
Apr 29 08:40:38 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:38 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c.d0767125-7d04-43ec-a101-22b544925757" returned: 0 in 0.643s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-quobyte-d0767125-7d04-43ec-a101-22b544925757" released by "_delete_snapshot" :: held 3.146s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-quobyte-de99b5ff-061d-4509-b4a7-40684230d68c" released by "delete_snapshot" :: held 3.172s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:38 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964" returned: 0 in 0.674s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2093408136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6639bc9-3527-4e14-a607-bf5b8bed7cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731917d3e8a346bab1e417bd551968a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:37Z,use_quota=True,user_id='64798973d9c243cebb41b8f04006ad10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Creating volume e6639bc9-3527-4e14-a607-bf5b8bed7cae {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:38 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da4f029-7abb-4cde-9626-9d38960a9c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:38 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae 1073741824
Apr 29 08:40:38 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d09281f-b48c-448a-af1d-9d5f4ce3d8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:38 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Volume volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964 (e3c2fa54-5c8b-4bbd-a52a-5c53281e6964): created successfully
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d09281f-b48c-448a-af1d-9d5f4ce3d8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Flow 'volume_create_manager' (386a6147-6b05-490a-888c-42b108bde871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Created reservations ['55313701-3d53-4ab6-8fdf-981e0b9ebfd1', 'c87b62d4-df5e-44d7-834f-fc5aa19092ef', '00724637-7bd3-4c1d-b340-0b77de514a0c', '7513b513-8d8c-43f5-81bc-5339335e1a62'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:38 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ee00fac5-370d-4649-9814-3df4cf4f1ca0 tempest-VolumesListTestJSON-549360821 None] Created volume successfully.
Apr 29 08:40:38 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Delete snapshot completed successfully.
Apr 29 08:40:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-13f30929-8781-4e3f-9e57-cd0193b7ac11 tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-d0767125-7d04-43ec-a101-22b544925757-delete_snapshot" released by "delete_snapshot" :: held 3.445s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:39 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4e287e1d-d2df-43c2-92f4-6c59138f0a0f" returned: 0 in 0.750s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Lock "cinder-quobyte-4e287e1d-d2df-43c2-92f4-6c59138f0a0f" released by "delete_volume" :: held 1.608s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:39 devstack cinder-volume[83885]: WARNING cinder.quota [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1703694193 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1703694193, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:40:39 devstack cinder-volume[83885]: WARNING cinder.quota [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1703694193 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1703694193, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Created reservations ['c1244173-5e8f-44a6-99e7-a2eb77d7e925', '81437f68-1182-4f32-8221-19e7863e1b16', 'a0e845f7-95f9-4c1e-82a1-ac9a06a020c9', 'd1a28558-25c7-424e-815a-881e1ca2cf9d'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:39 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:39 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Flow 'volume_create_manager' (e45bf158-ff85-441b-8cde-eb0f078f8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a522615e-dc6d-47f1-8354-aa71010b912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a522615e-dc6d-47f1-8354-aa71010b912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1627760234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a734aa99-3a3f-4d56-a3d7-691939c90eed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25527987f8744086b1f55a4d88af90c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:39Z,use_quota=True,user_id='463c898d402e4f35a89fba34c3d59226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903af487-09a4-45b1-9259-d29aa36bae4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903af487-09a4-45b1-9259-d29aa36bae4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a95b6c-0152-4646-acac-512f1e803750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a95b6c-0152-4646-acac-512f1e803750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a734aa99-3a3f-4d56-a3d7-691939c90eed', 'volume_name': 'volume-a734aa99-3a3f-4d56-a3d7-691939c90eed', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dbd5f6-dfdb-4528-97b3-ba6a8ebc3b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dbd5f6-dfdb-4528-97b3-ba6a8ebc3b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b7879a-6433-4505-bd9c-9c76c0ff29eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:39 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Volume a734aa99-3a3f-4d56-a3d7-691939c90eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a734aa99-3a3f-4d56-a3d7-691939c90eed', 'volume_size': 1}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:39 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae 1073741824" returned: 0 in 0.909s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:39 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae
Apr 29 08:40:39 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Acquiring lock "cinder-de99b5ff-061d-4509-b4a7-40684230d68c-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-de99b5ff-061d-4509-b4a7-40684230d68c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Acquiring lock "cinder-quobyte-de99b5ff-061d-4509-b4a7-40684230d68c" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:39 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-quobyte-de99b5ff-061d-4509-b4a7-40684230d68c" acquired by "delete_volume" :: waited 0.030s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.722s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:39 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Deleted volume successfully.
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b733e25-fb8d-4327-b9fe-3411086b481d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b5ceb8a6-9068-4d33-a667-dd00c5f5b0d1 tempest-VolumeTypesAccessTest-1503254802 None] Lock "cinder-4e287e1d-d2df-43c2-92f4-6c59138f0a0f-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:40 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c
Apr 29 08:40:40 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:40 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae" returned: 0 in 0.745s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1627760234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a734aa99-3a3f-4d56-a3d7-691939c90eed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25527987f8744086b1f55a4d88af90c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:39Z,use_quota=True,user_id='463c898d402e4f35a89fba34c3d59226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Creating volume a734aa99-3a3f-4d56-a3d7-691939c90eed {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:40 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06ef419-2682-4126-a765-234909dbccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:40 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed 1073741824
Apr 29 08:40:40 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce76378a-bd98-4d5d-b78e-7a54d0b7f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:40 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Volume volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae (e6639bc9-3527-4e14-a607-bf5b8bed7cae): created successfully
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce76378a-bd98-4d5d-b78e-7a54d0b7f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Flow 'volume_create_manager' (77365140-ad77-4175-aca7-97a80c39068a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:40 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c40a28d4-098f-44b2-876c-324199e0af41 tempest-VolumesNegativeTest-1048728471 None] Created volume successfully.
Apr 29 08:40:40 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c" returned: 0 in 0.807s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:40 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c
Apr 29 08:40:40 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:41 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed 1073741824" returned: 0 in 0.910s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:41 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed
Apr 29 08:40:41 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:41 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-de99b5ff-061d-4509-b4a7-40684230d68c" returned: 0 in 0.776s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-quobyte-de99b5ff-061d-4509-b4a7-40684230d68c" released by "delete_volume" :: held 1.675s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Created reservations ['ac728d87-5c44-42e9-a73a-06c2bd563e6a', 'f6c08562-8218-4184-8cc4-cad08bcf4c44', 'bf6428b7-cd3c-44ea-bd6b-348560ed3f73', '0a4f755a-69ab-4d5e-9a06-2578c586e5c4'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:41 devstack sudo[90520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:41 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:42 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed" returned: 0 in 0.771s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b7879a-6433-4505-bd9c-9c76c0ff29eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a734aa99-3a3f-4d56-a3d7-691939c90eed', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c19658a-79e3-4151-bb0b-c20f913538f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:42 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Volume volume-a734aa99-3a3f-4d56-a3d7-691939c90eed (a734aa99-3a3f-4d56-a3d7-691939c90eed): created successfully
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c19658a-79e3-4151-bb0b-c20f913538f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Flow 'volume_create_manager' (e45bf158-ff85-441b-8cde-eb0f078f8296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-f87aeda8-1a85-4e40-8369-85131943552e tempest-VolumesListTestJSON-549360821 None] Created volume successfully.
Apr 29 08:40:42 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.886s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Deleted volume successfully.
Apr 29 08:40:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c57dd96f-8a09-4cbc-8063-107cb4cba3ef tempest-VolumesSnapshotNegativeTestJSON-1791658296 None] Lock "cinder-de99b5ff-061d-4509-b4a7-40684230d68c-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Flow 'volume_create_manager' (28d15fe9-bb29-44b8-9c0d-4b32127d1e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445772f4-5664-497e-bca2-8e912cd2726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445772f4-5664-497e-bca2-8e912cd2726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1689384710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e99170-56f1-430b-9fd1-0046ea01072e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25527987f8744086b1f55a4d88af90c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:43Z,use_quota=True,user_id='463c898d402e4f35a89fba34c3d59226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2583a9-3a89-4db9-82fe-c7e30bf5d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2583a9-3a89-4db9-82fe-c7e30bf5d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860ff3ce-0c7a-470c-930b-cb44df4f537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860ff3ce-0c7a-470c-930b-cb44df4f537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e99170-56f1-430b-9fd1-0046ea01072e', 'volume_name': 'volume-f8e99170-56f1-430b-9fd1-0046ea01072e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac320c12-85b3-4820-9e02-bc72f02da0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac320c12-85b3-4820-9e02-bc72f02da0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3faf0875-ab9a-4f68-b354-f74216e3c8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:43 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Volume f8e99170-56f1-430b-9fd1-0046ea01072e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e99170-56f1-430b-9fd1-0046ea01072e', 'volume_size': 1}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1689384710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e99170-56f1-430b-9fd1-0046ea01072e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25527987f8744086b1f55a4d88af90c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:43Z,use_quota=True,user_id='463c898d402e4f35a89fba34c3d59226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Creating volume f8e99170-56f1-430b-9fd1-0046ea01072e {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:43 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:43 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e 1073741824
Apr 29 08:40:43 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:44 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e 1073741824" returned: 0 in 1.029s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:44 devstack sudo[90532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e
Apr 29 08:40:44 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:45 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e" returned: 0 in 0.679s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3faf0875-ab9a-4f68-b354-f74216e3c8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e99170-56f1-430b-9fd1-0046ea01072e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9098fa9e-fb30-4be5-88f1-ebfc21ddc561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:45 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Volume volume-f8e99170-56f1-430b-9fd1-0046ea01072e (f8e99170-56f1-430b-9fd1-0046ea01072e): created successfully
Apr 29 08:40:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9098fa9e-fb30-4be5-88f1-ebfc21ddc561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Flow 'volume_create_manager' (28d15fe9-bb29-44b8-9c0d-4b32127d1e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:45 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-eab6b524-d8e3-4b8d-8324-cf1e857c1895 tempest-VolumesListTestJSON-549360821 None] Created volume successfully.
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (022263d4-1418-4aa2-aada-683c7136c5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c767882-5a1c-4e57-9d73-5f76483d7c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c767882-5a1c-4e57-9d73-5f76483d7c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056765340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bfa42c-0232-4bbc-b111-674673220185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:46Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ca1e10-0c7c-497e-92a4-d707fd3d2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ca1e10-0c7c-497e-92a4-d707fd3d2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08997edb-6384-4e66-8ec0-e08d362d1428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08997edb-6384-4e66-8ec0-e08d362d1428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91bfa42c-0232-4bbc-b111-674673220185', 'volume_name': 'volume-91bfa42c-0232-4bbc-b111-674673220185', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2c52a3-45c7-4c89-8f00-6b5b483fa3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2c52a3-45c7-4c89-8f00-6b5b483fa3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34263abd-d49f-45de-a1b7-b77a5096d54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:46 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume 91bfa42c-0232-4bbc-b111-674673220185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91bfa42c-0232-4bbc-b111-674673220185', 'volume_size': 1}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056765340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bfa42c-0232-4bbc-b111-674673220185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:46Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Creating volume 91bfa42c-0232-4bbc-b111-674673220185 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:46 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:46 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185 1073741824
Apr 29 08:40:46 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:47 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185 1073741824" returned: 0 in 1.023s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:47 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185
Apr 29 08:40:47 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:47 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185" returned: 0 in 0.844s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34263abd-d49f-45de-a1b7-b77a5096d54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91bfa42c-0232-4bbc-b111-674673220185', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0a860d-6afa-43d3-aff9-8f62d1a1ad61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:48 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume volume-91bfa42c-0232-4bbc-b111-674673220185 (91bfa42c-0232-4bbc-b111-674673220185): created successfully
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0a860d-6afa-43d3-aff9-8f62d1a1ad61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (022263d4-1418-4aa2-aada-683c7136c5e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:48 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-9a9203be-9478-44df-935b-4b8791b1baaa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created volume successfully.
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Flow 'volume_create_manager' (27719ec5-d9d2-442c-b4bc-ed49a44e7d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b997a1-70dc-4e75-9292-44ee9d40e3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b997a1-70dc-4e75-9292-44ee9d40e3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-466134394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4dad471f434efaa68ee9f86f7b5b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:48Z,use_quota=True,user_id='af7956b1e3b544deba7cfdf15b3bc094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e641684-1054-4197-91a0-3c4499ac08b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e641684-1054-4197-91a0-3c4499ac08b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d289c0-e5ae-45db-b813-e9b59ca5c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d289c0-e5ae-45db-b813-e9b59ca5c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0', 'volume_name': 'volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4a0b08-b784-42b7-8eda-3bd20b39ed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4a0b08-b784-42b7-8eda-3bd20b39ed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617e94c0-9d3e-4b0c-8ee6-f1778ba4b419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:48 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Volume df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0', 'volume_size': 1}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-466134394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4dad471f434efaa68ee9f86f7b5b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:48Z,use_quota=True,user_id='af7956b1e3b544deba7cfdf15b3bc094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Creating volume df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:48 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:48 devstack sudo[90543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0 1073741824
Apr 29 08:40:48 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "cinder-f8e99170-56f1-430b-9fd1-0046ea01072e-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-f8e99170-56f1-430b-9fd1-0046ea01072e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "cinder-quobyte-f8e99170-56f1-430b-9fd1-0046ea01072e" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-quobyte-f8e99170-56f1-430b-9fd1-0046ea01072e" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cd5246-219d-4082-a91b-7acf780fd335]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:48 devstack sudo[90545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e
Apr 29 08:40:48 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:49 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0 1073741824" returned: 0 in 1.055s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:49 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e" returned: 0 in 0.867s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:49 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e
Apr 29 08:40:49 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:49 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0
Apr 29 08:40:49 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:49 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:49 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:50 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0" returned: 0 in 0.761s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.528s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617e94c0-9d3e-4b0c-8ee6-f1778ba4b419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74a45e2-afea-40be-ad55-3068e092422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Creating offline snapshot 35826c38-e210-4aec-bd70-fa96a88cf24d of volume 91bfa42c-0232-4bbc-b111-674673220185 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:40:50 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Volume volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0 (df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0): created successfully
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74a45e2-afea-40be-ad55-3068e092422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Flow 'volume_create_manager' (27719ec5-d9d2-442c-b4bc-ed49a44e7d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fa0493-cb0c-4a3a-8ce7-02b11611ee51]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:50 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5b420765-c005-48ba-b274-145995adde6c tempest-VolumesListAdminTestJSON-126391466 None] Created volume successfully.
Apr 29 08:40:50 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8e99170-56f1-430b-9fd1-0046ea01072e" returned: 0 in 1.007s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-quobyte-f8e99170-56f1-430b-9fd1-0046ea01072e" released by "delete_volume" :: held 1.946s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:50 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185
Apr 29 08:40:50 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Created reservations ['1381150b-2b2e-4cef-b290-9c6242f1a23d', 'b2dccfd4-d51f-4ccd-a80b-0c9e0ccff27c', 'f5cb2c9e-ca43-4640-b845-893e95454ec3', '210430c0-9775-4994-82e5-a8a4e59426ee'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:50 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:50 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:50 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.869s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "cinder-a734aa99-3a3f-4d56-a3d7-691939c90eed-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-a734aa99-3a3f-4d56-a3d7-691939c90eed-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "cinder-quobyte-a734aa99-3a3f-4d56-a3d7-691939c90eed" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-quobyte-a734aa99-3a3f-4d56-a3d7-691939c90eed" acquired by "delete_volume" :: waited 0.040s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b1dbb-cd7a-429f-aff9-44b3833b03fa]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:51 devstack sudo[90584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed
Apr 29 08:40:51 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:51 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185" returned: 0 in 0.986s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:51 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d 1G
Apr 29 08:40:51 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:51 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.820s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:51 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:51 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Deleted volume successfully.
Apr 29 08:40:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d6fc1767-a147-46fa-a14b-04a1317f2420 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-f8e99170-56f1-430b-9fd1-0046ea01072e-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:51 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed" returned: 0 in 0.828s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:51 devstack sudo[90595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed
Apr 29 08:40:51 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Flow 'volume_create_manager' (8f7b9786-9dd9-45d2-8d4d-607558400880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6e72df-7ffb-448c-96ce-2b9228da4aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6e72df-7ffb-448c-96ce-2b9228da4aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-977799892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d6a932-be44-47a7-94cf-890ebe7d9e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4dad471f434efaa68ee9f86f7b5b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:52Z,use_quota=True,user_id='af7956b1e3b544deba7cfdf15b3bc094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eecf2a6-3c12-4f1b-8541-a1e2e751bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eecf2a6-3c12-4f1b-8541-a1e2e751bba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea919ada-d8c0-4063-9c93-bfe3d2124795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea919ada-d8c0-4063-9c93-bfe3d2124795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d6a932-be44-47a7-94cf-890ebe7d9e81', 'volume_name': 'volume-44d6a932-be44-47a7-94cf-890ebe7d9e81', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097390be-fcc9-4fe8-a846-79f7bbadea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097390be-fcc9-4fe8-a846-79f7bbadea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ca2d34-52a5-4415-91e2-1bbb80d716a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:52 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Volume 44d6a932-be44-47a7-94cf-890ebe7d9e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d6a932-be44-47a7-94cf-890ebe7d9e81', 'volume_size': 1}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:52 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d 1G" returned: 0 in 0.963s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91bfa42c-0232-4bbc-b111-674673220185 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:52 devstack sudo[90601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91bfa42c-0232-4bbc-b111-674673220185 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d
Apr 29 08:40:52 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:52 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a734aa99-3a3f-4d56-a3d7-691939c90eed" returned: 0 in 0.705s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-quobyte-a734aa99-3a3f-4d56-a3d7-691939c90eed" released by "delete_volume" :: held 1.584s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Created reservations ['4778a5b4-01be-4e41-99c5-da5f86892028', 'd05488d2-abd1-4b2b-89ea-b960099b4172', '85da38a1-c01b-4cae-bcff-d1c4d7375b49', 'fd7f2de2-a2b5-43a4-990f-1def74fbfe22'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:52 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:52 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:52 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91bfa42c-0232-4bbc-b111-674673220185 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d" returned: 0 in 0.703s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:52 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d is being set with open permissions: ugo+rw
Apr 29 08:40:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:53 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d
Apr 29 08:40:53 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "cinder-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "cinder-quobyte-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-quobyte-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964" acquired by "delete_volume" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68a2052-62ab-4fc6-b67c-1b7125a6a103]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:53 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.717s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:53 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Deleted volume successfully.
Apr 29 08:40:53 devstack sudo[90613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964
Apr 29 08:40:53 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5a9b2bfb-3658-4388-98e5-edf109fe91e3 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-a734aa99-3a3f-4d56-a3d7-691939c90eed-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:53 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d" returned: 0 in 0.694s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:53 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.info
Apr 29 08:40:53 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:54 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964" returned: 0 in 0.768s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:54 devstack sudo[90624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964
Apr 29 08:40:54 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:54 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.info" returned: 0 in 0.645s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:54 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.info is being set with open permissions: ugo+rw
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:54 devstack sudo[90627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.info
Apr 29 08:40:54 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:54 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964" returned: 0 in 0.614s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-quobyte-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964" released by "delete_volume" :: held 1.432s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Created reservations ['c3af3326-779b-4fb4-aa2f-ebe3fd9f1b4b', '81af2995-e5ed-4a68-94ad-4520ec343d97', 'c4d1c553-32ae-4a0c-befc-12fd987e883c', '2b6fc112-2009-438b-960f-4d01182b99ad'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:54 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:40:54 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:55 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.info" returned: 0 in 0.658s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.812s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.768s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-977799892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d6a932-be44-47a7-94cf-890ebe7d9e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4dad471f434efaa68ee9f86f7b5b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:52Z,use_quota=True,user_id='af7956b1e3b544deba7cfdf15b3bc094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Creating volume 44d6a932-be44-47a7-94cf-890ebe7d9e81 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:55 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:55 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81 1073741824
Apr 29 08:40:55 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:55 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-900b6cf7-6aeb-4854-874e-111f69d8313e tempest-CreateVolumesFromSnapshotTest-1274037106 None] Create snapshot completed successfully
Apr 29 08:40:55 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.669s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:55 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Deleted volume successfully.
Apr 29 08:40:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2968bd4e-a8e3-4b70-b6d7-b908663cd6a0 tempest-VolumesListTestJSON-549360821 None] Lock "cinder-e3c2fa54-5c8b-4bbd-a52a-5c53281e6964-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:56 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81 1073741824" returned: 0 in 1.239s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:56 devstack sudo[90691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81
Apr 29 08:40:56 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:56 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (277d7b6d-0394-46b8-8fd4-b318af670c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd1a2fe-40d3-4ea3-8446-1c2070bb1512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd1a2fe-40d3-4ea3-8446-1c2070bb1512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1346269601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5137d835-5957-4d0f-9c34-89f7b082930d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:57Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fce1fa-8cd4-4e99-9ace-c1c04a6f6645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fce1fa-8cd4-4e99-9ace-c1c04a6f6645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce12db8f-572d-45c5-a1a3-ccc593163f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce12db8f-572d-45c5-a1a3-ccc593163f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5137d835-5957-4d0f-9c34-89f7b082930d', 'volume_name': 'volume-5137d835-5957-4d0f-9c34-89f7b082930d', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054ba592-b09d-44ef-9acd-3a30b6c30973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054ba592-b09d-44ef-9acd-3a30b6c30973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56414a8-ac6d-4dbe-a7c8-0d02b9de2b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume 5137d835-5957-4d0f-9c34-89f7b082930d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5137d835-5957-4d0f-9c34-89f7b082930d', 'volume_size': 1}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (3e733bc8-5484-4c68-9d3e-b5b77f9f58ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4dfc96-680a-4e03-a2c5-5fd83ebeacc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4dfc96-680a-4e03-a2c5-5fd83ebeacc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701732309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81083a82-0b6b-4acf-8513-edc66e38ac7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:58Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cae747-2679-4506-9d62-54860428c44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0cae747-2679-4506-9d62-54860428c44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec31c29-1cb5-46d7-96cc-b6d54734d5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec31c29-1cb5-46d7-96cc-b6d54734d5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81083a82-0b6b-4acf-8513-edc66e38ac7d', 'volume_name': 'volume-81083a82-0b6b-4acf-8513-edc66e38ac7d', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58cc122-70b6-458d-b689-7b0f094a2d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58cc122-70b6-458d-b689-7b0f094a2d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76616f38-e359-440e-94be-079e3d58c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume 81083a82-0b6b-4acf-8513-edc66e38ac7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81083a82-0b6b-4acf-8513-edc66e38ac7d', 'volume_size': 1}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:57 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81" returned: 0 in 1.622s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] <== create_volume: return (2948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.954s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1346269601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5137d835-5957-4d0f-9c34-89f7b082930d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:57Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Creating volume 5137d835-5957-4d0f-9c34-89f7b082930d {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:58 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ca2d34-52a5-4415-91e2-1bbb80d716a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d6a932-be44-47a7-94cf-890ebe7d9e81', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:58 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d 1073741824
Apr 29 08:40:58 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897d8a3c-3dea-4c28-a7b3-0baae9d2003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:58 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Volume volume-44d6a932-be44-47a7-94cf-890ebe7d9e81 (44d6a932-be44-47a7-94cf-890ebe7d9e81): created successfully
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897d8a3c-3dea-4c28-a7b3-0baae9d2003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Flow 'volume_create_manager' (8f7b9786-9dd9-45d2-8d4d-607558400880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:58 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-05fafced-ab0e-4260-b6ce-7abcfbb0f6a2 tempest-VolumesListAdminTestJSON-126391466 None] Created volume successfully.
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (f7809075-f7db-4557-8075-1aac22a78772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f18f36e-5bb2-4267-8dbf-348959ad82fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f18f36e-5bb2-4267-8dbf-348959ad82fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-533688854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f669c3c8-cc2d-4759-b95a-72a27572d15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:58Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17f75c0-4070-4d0d-b966-d309d0880adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17f75c0-4070-4d0d-b966-d309d0880adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f866895-9663-46bd-934f-f3f63d6396c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f866895-9663-46bd-934f-f3f63d6396c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f669c3c8-cc2d-4759-b95a-72a27572d15c', 'volume_name': 'volume-f669c3c8-cc2d-4759-b95a-72a27572d15c', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b13c648-e7c4-4b9d-89fc-6ce37c0ab498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b13c648-e7c4-4b9d-89fc-6ce37c0ab498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f5e5d8-3450-4fa6-906b-3f7edb8fb609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:58 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume f669c3c8-cc2d-4759-b95a-72a27572d15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f669c3c8-cc2d-4759-b95a-72a27572d15c', 'volume_size': 1}
Apr 29 08:40:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (51605c32-07af-4112-8106-56d601866300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35d96c1-432f-4800-857d-286881a0751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35d96c1-432f-4800-857d-286881a0751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858099097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6017e616-2550-42fb-981f-b5f91f99ecfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:59Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d17b214-306b-404d-a6ae-a19dc03478c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d17b214-306b-404d-a6ae-a19dc03478c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8f6afc-0fc4-4b47-8cba-d4ec36672572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8f6afc-0fc4-4b47-8cba-d4ec36672572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6017e616-2550-42fb-981f-b5f91f99ecfb', 'volume_name': 'volume-6017e616-2550-42fb-981f-b5f91f99ecfb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b37c43-5cdc-40e7-aca2-32008005595b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b37c43-5cdc-40e7-aca2-32008005595b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db300347-2091-4636-a393-480f70fb923e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:59 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume 6017e616-2550-42fb-981f-b5f91f99ecfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6017e616-2550-42fb-981f-b5f91f99ecfb', 'volume_size': 1}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:59 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (c00445a3-d13a-412f-9a53-1a6e227e9a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7ad8c6-5086-4515-9d87-720cb161c6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7ad8c6-5086-4515-9d87-720cb161c6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415118643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7de685-e47d-41f3-b70c-19b895ed3f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:00Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1445bc-49a4-4229-b1de-3fb144b227c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1445bc-49a4-4229-b1de-3fb144b227c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033f9233-dfd8-48dd-a266-4bab9b340981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033f9233-dfd8-48dd-a266-4bab9b340981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7de685-e47d-41f3-b70c-19b895ed3f11', 'volume_name': 'volume-bd7de685-e47d-41f3-b70c-19b895ed3f11', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4eaa24f-6af3-44eb-94f4-8f8d50ece28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4eaa24f-6af3-44eb-94f4-8f8d50ece28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79ca6e2-a450-48ed-ae8b-1667ea6b267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume bd7de685-e47d-41f3-b70c-19b895ed3f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7de685-e47d-41f3-b70c-19b895ed3f11', 'volume_size': 1}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d 1073741824" returned: 0 in 2.097s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Flow 'volume_create_manager' (6431b1db-4b68-4552-b7f8-48cd31d4c907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b48e8f-3fbb-4b98-befb-9bad0715cea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b48e8f-3fbb-4b98-befb-9bad0715cea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-59460318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820200d2-51fb-49ac-995d-a39be16f3ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4dad471f434efaa68ee9f86f7b5b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:00Z,use_quota=True,user_id='af7956b1e3b544deba7cfdf15b3bc094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9b8065-d8e4-4f8c-b233-1414ff8bb314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9b8065-d8e4-4f8c-b233-1414ff8bb314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daa896e-f3c9-4c1a-9657-8335f66ec491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daa896e-f3c9-4c1a-9657-8335f66ec491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820200d2-51fb-49ac-995d-a39be16f3ff7', 'volume_name': 'volume-820200d2-51fb-49ac-995d-a39be16f3ff7', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e7748c-14f9-4cb3-84c6-6bd24adce5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e7748c-14f9-4cb3-84c6-6bd24adce5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bee390f-ee81-4b9e-b478-5fee17f01b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Volume 820200d2-51fb-49ac-995d-a39be16f3ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820200d2-51fb-49ac-995d-a39be16f3ff7', 'volume_size': 1}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:00 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d
Apr 29 08:41:00 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:00 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d" returned: 0 in 0.752s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] <== create_volume: return (2983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.993s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.176s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701732309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81083a82-0b6b-4acf-8513-edc66e38ac7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:58Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Creating volume 81083a82-0b6b-4acf-8513-edc66e38ac7d {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:01 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56414a8-ac6d-4dbe-a7c8-0d02b9de2b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5137d835-5957-4d0f-9c34-89f7b082930d', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44d4dbd-c56f-4860-90f9-a9ab86a26cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:01 devstack sudo[90716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d 1073741824
Apr 29 08:41:01 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:01 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume volume-5137d835-5957-4d0f-9c34-89f7b082930d (5137d835-5957-4d0f-9c34-89f7b082930d): created successfully
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44d4dbd-c56f-4860-90f9-a9ab86a26cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (277d7b6d-0394-46b8-8fd4-b318af670c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a5fd27ef-eb8a-4aee-bbcc-3197d532f865 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created volume successfully.
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Flow 'volume_create_manager' (56e7b950-af9c-4b02-a9ca-d3fc7fc94cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbc1dce-443b-4209-963c-97b99147855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbc1dce-443b-4209-963c-97b99147855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-487516241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6742fe33-26ff-49e5-b276-074e6430bba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102257520c244419a7897ce5c9b39214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:02Z,use_quota=True,user_id='ab9eea0142914727b7fb847f96b40ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dbadcd-a8e7-47a3-97b6-32752dc48803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92dbadcd-a8e7-47a3-97b6-32752dc48803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8ad969-19f7-4cea-a306-9e9cde00c660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8ad969-19f7-4cea-a306-9e9cde00c660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6742fe33-26ff-49e5-b276-074e6430bba7', 'volume_name': 'volume-6742fe33-26ff-49e5-b276-074e6430bba7', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14ea88c-6899-4af6-ac58-846ed100ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14ea88c-6899-4af6-ac58-846ed100ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c048df8a-b285-4237-9697-114c66d4745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:01 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Volume 6742fe33-26ff-49e5-b276-074e6430bba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6742fe33-26ff-49e5-b276-074e6430bba7', 'volume_size': 1}
Apr 29 08:41:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:02 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d 1073741824" returned: 0 in 1.021s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:02 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d
Apr 29 08:41:02 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:02 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d" returned: 0 in 0.700s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.353s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-533688854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f669c3c8-cc2d-4759-b95a-72a27572d15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:58Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Creating volume f669c3c8-cc2d-4759-b95a-72a27572d15c {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:02 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:02 devstack sudo[90764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c 1073741824
Apr 29 08:41:02 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76616f38-e359-440e-94be-079e3d58c283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81083a82-0b6b-4acf-8513-edc66e38ac7d', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecb70c4-c0d3-49f0-aaa5-4b9f2d34c00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:02 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume volume-81083a82-0b6b-4acf-8513-edc66e38ac7d (81083a82-0b6b-4acf-8513-edc66e38ac7d): created successfully
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecb70c4-c0d3-49f0-aaa5-4b9f2d34c00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (3e733bc8-5484-4c68-9d3e-b5b77f9f58ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-51d77780-4904-4011-bd77-85a4ee955176 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created volume successfully.
Apr 29 08:41:03 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c 1073741824" returned: 0 in 0.877s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:03 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c
Apr 29 08:41:03 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:04 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c" returned: 0 in 0.678s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.113s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858099097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6017e616-2550-42fb-981f-b5f91f99ecfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:59Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Creating volume 6017e616-2550-42fb-981f-b5f91f99ecfb {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:04 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f5e5d8-3450-4fa6-906b-3f7edb8fb609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f669c3c8-cc2d-4759-b95a-72a27572d15c', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:04 devstack sudo[90775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb 1073741824
Apr 29 08:41:04 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f8aae5-f5df-46e3-9b9b-6ddf270cb439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:04 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume volume-f669c3c8-cc2d-4759-b95a-72a27572d15c (f669c3c8-cc2d-4759-b95a-72a27572d15c): created successfully
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f8aae5-f5df-46e3-9b9b-6ddf270cb439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (f7809075-f7db-4557-8075-1aac22a78772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:04 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2936f68e-49ce-45c1-ad36-f1f519bca0aa tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created volume successfully.
Apr 29 08:41:05 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb 1073741824" returned: 0 in 0.770s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:05 devstack sudo[90781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb
Apr 29 08:41:05 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:05 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb" returned: 0 in 0.600s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.790s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415118643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7de685-e47d-41f3-b70c-19b895ed3f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eff6d246ba94e15a90f48096747c285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:00Z,use_quota=True,user_id='8fa2a681c56e407495afd7bc130a356a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Creating volume bd7de685-e47d-41f3-b70c-19b895ed3f11 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:05 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db300347-2091-4636-a393-480f70fb923e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6017e616-2550-42fb-981f-b5f91f99ecfb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:05 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11 1073741824
Apr 29 08:41:05 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25076d94-74c2-4e44-9946-34a882936016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:05 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume volume-6017e616-2550-42fb-981f-b5f91f99ecfb (6017e616-2550-42fb-981f-b5f91f99ecfb): created successfully
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25076d94-74c2-4e44-9946-34a882936016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (51605c32-07af-4112-8106-56d601866300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d70da3b6-b58d-4643-a970-3e83ce8b6073 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created volume successfully.
Apr 29 08:41:06 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11 1073741824" returned: 0 in 0.781s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:06 devstack sudo[90791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11
Apr 29 08:41:06 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:07 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11" returned: 0 in 0.612s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.138s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-59460318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820200d2-51fb-49ac-995d-a39be16f3ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4dad471f434efaa68ee9f86f7b5b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:00Z,use_quota=True,user_id='af7956b1e3b544deba7cfdf15b3bc094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Creating volume 820200d2-51fb-49ac-995d-a39be16f3ff7 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:07 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79ca6e2-a450-48ed-ae8b-1667ea6b267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7de685-e47d-41f3-b70c-19b895ed3f11', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:07 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7 1073741824
Apr 29 08:41:07 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fcfce5-9b32-40f6-b994-5c6cf3d67431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:07 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Volume volume-bd7de685-e47d-41f3-b70c-19b895ed3f11 (bd7de685-e47d-41f3-b70c-19b895ed3f11): created successfully
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fcfce5-9b32-40f6-b994-5c6cf3d67431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Flow 'volume_create_manager' (c00445a3-d13a-412f-9a53-1a6e227e9a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:07 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ec3d1db8-824b-470c-aaea-3148937c771d tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created volume successfully.
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-bd7de685-e47d-41f3-b70c-19b895ed3f11-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-bd7de685-e47d-41f3-b70c-19b895ed3f11-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-quobyte-bd7de685-e47d-41f3-b70c-19b895ed3f11" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-bd7de685-e47d-41f3-b70c-19b895ed3f11" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:07 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e1a0c-8701-4c64-bb3e-c318ff044a8d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:08 devstack sudo[90800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11
Apr 29 08:41:08 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:08 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7 1073741824" returned: 0 in 0.810s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:08 devstack sudo[90802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7
Apr 29 08:41:08 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:08 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11" returned: 0 in 0.763s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:08 devstack sudo[90809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11
Apr 29 08:41:08 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:08 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7" returned: 0 in 0.609s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.186s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-487516241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6742fe33-26ff-49e5-b276-074e6430bba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102257520c244419a7897ce5c9b39214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:02Z,use_quota=True,user_id='ab9eea0142914727b7fb847f96b40ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Creating volume 6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:08 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bee390f-ee81-4b9e-b478-5fee17f01b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820200d2-51fb-49ac-995d-a39be16f3ff7', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:08 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7 1073741824
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671497bd-0fad-4bf3-bb33-8c6afcebb565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:08 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:08 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Volume volume-820200d2-51fb-49ac-995d-a39be16f3ff7 (820200d2-51fb-49ac-995d-a39be16f3ff7): created successfully
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671497bd-0fad-4bf3-bb33-8c6afcebb565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Flow 'volume_create_manager' (6431b1db-4b68-4552-b7f8-48cd31d4c907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:08 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-dcaf0f2b-8513-49b8-9d78-e401558db4cc tempest-VolumesListAdminTestJSON-126391466 None] Created volume successfully.
Apr 29 08:41:09 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bd7de685-e47d-41f3-b70c-19b895ed3f11" returned: 0 in 0.740s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-bd7de685-e47d-41f3-b70c-19b895ed3f11" released by "delete_volume" :: held 1.546s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created reservations ['cbf019e2-8b1d-4879-9738-f348871c4bb2', '80ef57b3-bd7b-495a-b442-3ac59b134725', '5cfb67ba-3901-4c09-8110-af504fd6f200', '8cdfb683-9b05-4cad-a87a-5024b0753d44'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:09 devstack sudo[90818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:09 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:09 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7 1073741824" returned: 0 in 1.101s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:10 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7
Apr 29 08:41:10 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-6017e616-2550-42fb-981f-b5f91f99ecfb-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-6017e616-2550-42fb-981f-b5f91f99ecfb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-quobyte-6017e616-2550-42fb-981f-b5f91f99ecfb" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-6017e616-2550-42fb-981f-b5f91f99ecfb" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6926ef4e-92e8-44d2-825c-b3f29b488ffa]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:10 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.777s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:10 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Deleted volume successfully.
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-95f87a14-2c46-4a5b-a81b-bd6406adf6a8 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-bd7de685-e47d-41f3-b70c-19b895ed3f11-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:10 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb
Apr 29 08:41:10 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:10 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Flow 'volume_create_manager' (acdf0606-9f45-4eb1-ae62-17d1053c6150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62cbbb5c-0889-4fa3-8d5b-4b8ca004735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7" returned: 0 in 0.889s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62cbbb5c-0889-4fa3-8d5b-4b8ca004735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0ffcb0-d4b1-41c6-84c3-36537949b440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239ffc19452a40bda8d2e5cc636ac43a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:11Z,use_quota=True,user_id='399b49c19e8b4895aa350af0cb62a491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07703b42-821e-4d90-8485-6db644080464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07703b42-821e-4d90-8485-6db644080464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3efe69-9c00-4e5e-a233-f1610c15d834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3efe69-9c00-4e5e-a233-f1610c15d834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd0ffcb0-d4b1-41c6-84c3-36537949b440', 'volume_name': 'volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db5b448-ee25-4fe6-8cc4-db593f2f9cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db5b448-ee25-4fe6-8cc4-db593f2f9cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d922c1-e3c8-4e3f-9e2d-295051659314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:10 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Volume fd0ffcb0-d4b1-41c6-84c3-36537949b440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440', 'volume_size': 1}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0ffcb0-d4b1-41c6-84c3-36537949b440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239ffc19452a40bda8d2e5cc636ac43a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:11Z,use_quota=True,user_id='399b49c19e8b4895aa350af0cb62a491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Creating volume fd0ffcb0-d4b1-41c6-84c3-36537949b440 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:10 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c048df8a-b285-4237-9697-114c66d4745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6742fe33-26ff-49e5-b276-074e6430bba7', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2f2b34-a1ad-4fd5-9c15-24a29878ccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:11 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440 1073741824
Apr 29 08:41:11 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:11 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Volume volume-6742fe33-26ff-49e5-b276-074e6430bba7 (6742fe33-26ff-49e5-b276-074e6430bba7): created successfully
Apr 29 08:41:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2f2b34-a1ad-4fd5-9c15-24a29878ccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Flow 'volume_create_manager' (56e7b950-af9c-4b02-a9ca-d3fc7fc94cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:11 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b882f12c-cf03-49b1-a362-bfe51b395685 tempest-VolumesSnapshotListTestJSON-1998660905 None] Created volume successfully.
Apr 29 08:41:11 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb" returned: 0 in 0.881s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:11 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb
Apr 29 08:41:11 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:12 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440 1073741824" returned: 0 in 1.090s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:12 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6017e616-2550-42fb-981f-b5f91f99ecfb" returned: 0 in 0.736s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-6017e616-2550-42fb-981f-b5f91f99ecfb" released by "delete_volume" :: held 1.697s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:12 devstack sudo[90841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440
Apr 29 08:41:12 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created reservations ['d7c13db1-89a1-41bc-8222-3c8c20f4ebf5', '4881b6d8-25ff-4c2a-859d-ea61a4cc58cf', '3a9ba02d-fa62-47f0-80cd-5ae9788bb184', '60e70f33-2961-4ad0-8d67-96231097e29d'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:12 devstack sudo[90843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:12 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-f669c3c8-cc2d-4759-b95a-72a27572d15c-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-f669c3c8-cc2d-4759-b95a-72a27572d15c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-quobyte-f669c3c8-cc2d-4759-b95a-72a27572d15c" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-f669c3c8-cc2d-4759-b95a-72a27572d15c" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf3f9d0-f278-47b4-a4ff-f4d9b32692aa]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:12 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440" returned: 0 in 0.717s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.310s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Creating offline snapshot eaf0e449-7a72-406c-9ffa-80dfde7d72a1 of volume 6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:41:12 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c
Apr 29 08:41:12 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d922c1-e3c8-4e3f-9e2d-295051659314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d2bd2f-956d-48ed-b23b-9bd7c6664579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6fdc1a-4b02-4e5a-bb07-ebc600c6a17c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:12 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Volume volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440 (fd0ffcb0-d4b1-41c6-84c3-36537949b440): created successfully
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d2bd2f-956d-48ed-b23b-9bd7c6664579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Flow 'volume_create_manager' (acdf0606-9f45-4eb1-ae62-17d1053c6150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:12 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.736s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:12 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:12 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Deleted volume successfully.
Apr 29 08:41:13 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-646efd93-fbf7-45b0-ae9b-c930d1f7ddd3 tempest-VolumesListAdminTestJSON-156353467 None] Created volume successfully.
Apr 29 08:41:13 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-bacf2a25-905a-42fd-87d2-00777e310a4b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-6017e616-2550-42fb-981f-b5f91f99ecfb-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:13 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7
Apr 29 08:41:13 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:13 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c" returned: 0 in 0.824s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:13 devstack sudo[90855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c
Apr 29 08:41:13 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:13 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7" returned: 0 in 0.845s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:13 devstack sudo[90860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 1G
Apr 29 08:41:13 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:14 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f669c3c8-cc2d-4759-b95a-72a27572d15c" returned: 0 in 0.673s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-f669c3c8-cc2d-4759-b95a-72a27572d15c" released by "delete_volume" :: held 1.558s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Acquiring lock "cinder-fd0ffcb0-d4b1-41c6-84c3-36537949b440-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created reservations ['47155db2-a7fc-4d32-874a-255fa5adb97c', '0fb8f76b-7376-4e12-9ca4-be1fb0b0c687', 'a46314d4-bdbc-4f26-9c36-048a588991f2', 'bef28847-771f-46c0-9168-d318a7e06365'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Lock "cinder-fd0ffcb0-d4b1-41c6-84c3-36537949b440-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Acquiring lock "cinder-quobyte-fd0ffcb0-d4b1-41c6-84c3-36537949b440" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Lock "cinder-quobyte-fd0ffcb0-d4b1-41c6-84c3-36537949b440" acquired by "delete_volume" :: waited 0.040s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c24357d-999c-4568-af2c-6b3b208530e2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "cinder-820200d2-51fb-49ac-995d-a39be16f3ff7-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:14 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:14 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-820200d2-51fb-49ac-995d-a39be16f3ff7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "cinder-quobyte-820200d2-51fb-49ac-995d-a39be16f3ff7" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:14 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 1G" returned: 0 in 0.938s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6742fe33-26ff-49e5-b276-074e6430bba7 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-quobyte-820200d2-51fb-49ac-995d-a39be16f3ff7" acquired by "delete_volume" :: waited 0.051s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:14 devstack sudo[90870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6742fe33-26ff-49e5-b276-074e6430bba7 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1
Apr 29 08:41:14 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:14 devstack sudo[90868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440
Apr 29 08:41:14 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce39cd0-4632-4cc4-9949-24c6625dff73]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-81083a82-0b6b-4acf-8513-edc66e38ac7d-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-81083a82-0b6b-4acf-8513-edc66e38ac7d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:15 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7
Apr 29 08:41:15 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-quobyte-81083a82-0b6b-4acf-8513-edc66e38ac7d" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-81083a82-0b6b-4acf-8513-edc66e38ac7d" acquired by "delete_volume" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f752c93-8257-4ac4-9d33-d579ed6e83f4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:15 devstack sudo[90875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d
Apr 29 08:41:15 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:15 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.155s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:15 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Deleted volume successfully.
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac1fe66f-be84-4ba2-b716-01092554cc56 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-f669c3c8-cc2d-4759-b95a-72a27572d15c-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:15 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6742fe33-26ff-49e5-b276-074e6430bba7 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1" returned: 0 in 1.168s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:15 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 is being set with open permissions: ugo+rw
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:15 devstack sudo[90884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1
Apr 29 08:41:15 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:15 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440" returned: 0 in 1.436s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:15 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440
Apr 29 08:41:15 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:16 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d" returned: 0 in 1.021s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:16 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7" returned: 0 in 1.471s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:16 devstack sudo[90894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d
Apr 29 08:41:16 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:16 devstack sudo[90896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7
Apr 29 08:41:16 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Acquiring lock "cinder-e6639bc9-3527-4e14-a607-bf5b8bed7cae-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Lock "cinder-e6639bc9-3527-4e14-a607-bf5b8bed7cae-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Acquiring lock "cinder-quobyte-e6639bc9-3527-4e14-a607-bf5b8bed7cae" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Lock "cinder-quobyte-e6639bc9-3527-4e14-a607-bf5b8bed7cae" acquired by "delete_volume" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2980ac-3e5a-424b-8f97-3e511b6c4843]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:16 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1" returned: 0 in 0.827s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:16 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.info
Apr 29 08:41:16 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:16 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae
Apr 29 08:41:16 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:16 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fd0ffcb0-d4b1-41c6-84c3-36537949b440" returned: 0 in 0.938s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Lock "cinder-quobyte-fd0ffcb0-d4b1-41c6-84c3-36537949b440" released by "delete_volume" :: held 2.470s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:16 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-81083a82-0b6b-4acf-8513-edc66e38ac7d" returned: 0 in 0.793s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-81083a82-0b6b-4acf-8513-edc66e38ac7d" released by "delete_volume" :: held 1.911s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Created reservations ['0fe154f3-bd16-44fe-b3c8-b04999943d9f', 'f70dc53c-a517-4f09-9166-642ee7e44ecf', 'e11a82a3-a413-4f43-bfae-185c13e82f6a', 'a5235d00-65f7-4596-9812-aafc0fb4fa2a'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:17 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-820200d2-51fb-49ac-995d-a39be16f3ff7" returned: 0 in 0.869s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created reservations ['96412220-5c49-4212-8a51-adf96d15cce3', 'b4b921e3-058c-419b-9653-eaede3e08cad', '3b8a3bc1-1f6e-4866-bb58-339561b77f24', 'e92b8ebe-dff4-4b91-afdb-7113ae1c4739'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-quobyte-820200d2-51fb-49ac-995d-a39be16f3ff7" released by "delete_volume" :: held 2.415s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:17 devstack sudo[90906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:17 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-5137d835-5957-4d0f-9c34-89f7b082930d-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:17 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:17 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Created reservations ['ffa3a3b7-bd7b-4470-86d0-2b6ae27166bc', 'cc298f4b-6c0b-4370-8fba-074d83517c99', 'ca6240b2-9236-4819-b35e-8cb927cfcb44', 'e42f6400-daf3-4456-81a6-9e5d73845f41'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-5137d835-5957-4d0f-9c34-89f7b082930d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-quobyte-5137d835-5957-4d0f-9c34-89f7b082930d" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-5137d835-5957-4d0f-9c34-89f7b082930d" acquired by "delete_volume" :: waited 0.039s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cd4335-8e99-4192-b22d-92f4f30ab300]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:17 devstack sudo[90911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:17 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:17 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.info" returned: 0 in 1.004s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:17 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.info is being set with open permissions: ugo+rw
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:17 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.info
Apr 29 08:41:17 devstack sudo[90912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d
Apr 29 08:41:17 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:17 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:17 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae" returned: 0 in 1.292s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:17 devstack sudo[90922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae
Apr 29 08:41:17 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "cinder-44d6a932-be44-47a7-94cf-890ebe7d9e81-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-44d6a932-be44-47a7-94cf-890ebe7d9e81-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:18 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.087s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Deleted volume successfully.
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=168,cinder:INSERT=45,cinder:UPDATE=207,cinder:DELETE=27 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "cinder-quobyte-44d6a932-be44-47a7-94cf-890ebe7d9e81" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2a219e28-cbcd-44ca-ab56-549be97903a8 tempest-VolumesListAdminTestJSON-156353467 None] Lock "cinder-fd0ffcb0-d4b1-41c6-84c3-36537949b440-delete_volume" released by "delete_volume" :: held 3.991s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-quobyte-44d6a932-be44-47a7-94cf-890ebe7d9e81" acquired by "delete_volume" :: waited 0.048s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c83895d-59fb-4a49-a654-f40e35a7e5bf]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:18 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.996s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Deleted volume successfully.
Apr 29 08:41:18 devstack sudo[90927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81
Apr 29 08:41:18 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d3744fd2-2881-4523-9857-bafd9d59d157 tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-820200d2-51fb-49ac-995d-a39be16f3ff7-delete_volume" released by "delete_volume" :: held 4.073s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:18 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.390s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Deleted volume successfully.
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24e9aa3f-4430-4f28-96b7-b5bcbe09b308 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-81083a82-0b6b-4acf-8513-edc66e38ac7d-delete_volume" released by "delete_volume" :: held 3.764s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:18 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.info" returned: 0 in 1.093s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.025s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-19625996-8a76-4226-8cac-c702766211e4 tempest-VolumesSnapshotListTestJSON-1998660905 None] Create snapshot completed successfully
Apr 29 08:41:18 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e6639bc9-3527-4e14-a607-bf5b8bed7cae" returned: 0 in 1.047s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Lock "cinder-quobyte-e6639bc9-3527-4e14-a607-bf5b8bed7cae" released by "delete_volume" :: held 2.410s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:19 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d" returned: 0 in 1.391s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:19 devstack sudo[90934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d
Apr 29 08:41:19 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Created reservations ['449ebef5-be5c-463a-9a82-8fe7289b05ce', '7d2ce48a-7bfd-4a89-a8bf-971b0893d9cc', 'd836772e-8cca-4e00-b36d-b463a4690492', 'c75a1670-d58e-4e65-8e77-8a9d6166fe12'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:19 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:19 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Creating offline snapshot b24cc74b-d461-41ec-8e61-b251aa6d2871 of volume 6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce39edb6-0e7f-4014-8e32-9ff30cdc1795]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:19 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81" returned: 0 in 0.977s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:19 devstack sudo[90942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81
Apr 29 08:41:19 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:19 devstack sudo[90941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1
Apr 29 08:41:19 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:19 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5137d835-5957-4d0f-9c34-89f7b082930d" returned: 0 in 0.759s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-5137d835-5957-4d0f-9c34-89f7b082930d" released by "delete_volume" :: held 2.254s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created reservations ['3815ea72-fc87-4460-9621-3e5830c4cebe', '49cff0f7-ac61-4e6b-a3ac-c4d83748d667', '8c99514c-f239-4547-b9a8-6bc26196e1b8', 'b162942c-b644-49c8-8a97-bcd8dd1ab2ae'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:19 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.769s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Deleted volume successfully.
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a7baeb32-53be-4539-83cf-96ed303b5379 tempest-VolumesNegativeTest-1048728471 None] Lock "cinder-e6639bc9-3527-4e14-a607-bf5b8bed7cae-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:20 devstack sudo[90947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:20 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:20 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-44d6a932-be44-47a7-94cf-890ebe7d9e81" returned: 0 in 0.763s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-quobyte-44d6a932-be44-47a7-94cf-890ebe7d9e81" released by "delete_volume" :: held 1.799s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Created reservations ['ba1daf2a-8814-4a20-9b09-a52ecfabc66f', '799b19d8-da43-488b-ab39-5b94080d1fae', '42908b66-3ecc-4f6d-a969-47588e2a4118', '365c61b8-5de5-447b-865a-b4dfb8a133a2'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:20 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1" returned: 0 in 0.977s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6742fe33-26ff-49e5-b276-074e6430bba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:20 devstack sudo[90954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:20 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:20 devstack sudo[90956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 1G
Apr 29 08:41:20 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "cinder-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "cinder-quobyte-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-quobyte-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0" acquired by "delete_volume" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[0626f1d6-343d-4442-b54b-c4d928893a7c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-35826c38-e210-4aec-bd70-fa96a88cf24d-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-35826c38-e210-4aec-bd70-fa96a88cf24d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-quobyte-91bfa42c-0232-4bbc-b111-674673220185" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-91bfa42c-0232-4bbc-b111-674673220185" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-quobyte-35826c38-e210-4aec-bd70-fa96a88cf24d" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:20 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.861s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:20 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Deleted volume successfully.
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-35826c38-e210-4aec-bd70-fa96a88cf24d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Deleting offline snapshot 35826c38-e210-4aec-bd70-fa96a88cf24d of volume 91bfa42c-0232-4bbc-b111-674673220185 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] snapshot_file for this snap is: volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd7ab63-4e29-4f76-bb8a-511992e6a9b4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c88e186b-41e1-4b3f-b1b9-75bed38fea0b tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-5137d835-5957-4d0f-9c34-89f7b082930d-delete_volume" released by "delete_volume" :: held 3.562s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:20 devstack sudo[90959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0
Apr 29 08:41:20 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:21 devstack sudo[90960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d
Apr 29 08:41:21 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:21 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.106s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:21 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:21 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Deleted volume successfully.
Apr 29 08:41:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-996603e5-65e2-4314-aeb5-720e4c3d78ad tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-44d6a932-be44-47a7-94cf-890ebe7d9e81-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:21 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 1G" returned: 0 in 1.349s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:21 devstack sudo[91003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871
Apr 29 08:41:21 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:22 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0" returned: 0 in 1.278s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:22 devstack sudo[91011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0
Apr 29 08:41:22 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:22 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d" returned: 0 in 1.154s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91bfa42c-0232-4bbc-b111-674673220185(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[fade0b9e-a271-482c-8056-76a57621dd7a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:22 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185
Apr 29 08:41:22 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:22 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871" returned: 0 in 0.819s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:22 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 is being set with open permissions: ugo+rw
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:22 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871
Apr 29 08:41:22 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:22 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0" returned: 0 in 0.706s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-quobyte-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0" released by "delete_volume" :: held 2.055s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Created reservations ['3d8220e6-8081-4172-bab0-ec52ce399ea0', '096b36a3-d7fc-4061-a681-a81e2e77c5a0', '512619b3-395e-4ae7-90f6-ae0ff1c22ebb', '0b756580-e778-4acb-82c4-e10f58199943'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:23 devstack sudo[91025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:23 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:23 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185" returned: 0 in 1.019s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:23 devstack sudo[91027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d
Apr 29 08:41:23 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:23 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871" returned: 0 in 0.808s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.118s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (33c4c093-bd6e-4b7b-a329-681d94105909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b9a055-04a5-4286-8abb-144af2151bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:23 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-80670616-8498-4df0-b58f-d1c4b12b10c0 tempest-VolumesSnapshotListTestJSON-1998660905 None] Create snapshot completed successfully
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b9a055-04a5-4286-8abb-144af2151bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-835957346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b628f51-1ae1-47c0-8020-60d28b1e07d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:23Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5dd861-e37b-4642-95e5-d377cf05a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5dd861-e37b-4642-95e5-d377cf05a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435a014f-3c0d-4f19-80e7-9730c868afcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435a014f-3c0d-4f19-80e7-9730c868afcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b628f51-1ae1-47c0-8020-60d28b1e07d3', 'volume_name': 'volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca43379-0f08-4f7e-8e96-3790c1820c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca43379-0f08-4f7e-8e96-3790c1820c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2668eda-04d7-4b2b-bd75-4c465a995cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:23 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Volume 8b628f51-1ae1-47c0-8020-60d28b1e07d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3', 'volume_size': 1}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-835957346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b628f51-1ae1-47c0-8020-60d28b1e07d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:23Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Creating volume 8b628f51-1ae1-47c0-8020-60d28b1e07d3 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:23 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:23 devstack sudo[91031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3 1073741824
Apr 29 08:41:23 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:23 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.774s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:23 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Deleted volume successfully.
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-158ad2bf-4f12-48cf-b6ab-13f006e4b752 tempest-VolumesListAdminTestJSON-126391466 None] Lock "cinder-df0ff8eb-412c-4f3b-87a4-a5e0cde8d9f0-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (45f3df79-daad-4ad2-9637-35a88f136a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b86b7c-597e-44af-b0bd-5b98bfea74ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:23 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b86b7c-597e-44af-b0bd-5b98bfea74ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-678591877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cd9c3d-6ba0-4db5-8f5e-3476799ebc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:24Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d63d1ff-eb8c-491b-80c9-1b8d100358c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d63d1ff-eb8c-491b-80c9-1b8d100358c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e78d36-9f6c-49cd-94f4-73dc2d514bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e78d36-9f6c-49cd-94f4-73dc2d514bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49cd9c3d-6ba0-4db5-8f5e-3476799ebc56', 'volume_name': 'volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b4b564-b503-4ad7-b7e8-830f3efb3f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b4b564-b503-4ad7-b7e8-830f3efb3f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840b8056-f99e-486d-b09f-ef2ef2c22c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:24 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Volume 49cd9c3d-6ba0-4db5-8f5e-3476799ebc56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56', 'volume_size': 1}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:24 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d" returned: 0 in 0.944s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:24 devstack sudo[91039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d
Apr 29 08:41:24 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (8490b0c8-dc1b-4439-9ef2-d0cd5ed3a792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089c7aea-de86-4347-b826-b723b03ce35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089c7aea-de86-4347-b826-b723b03ce35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-187142131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4271b16c-f71d-4205-8eb9-69e5cba3dde6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:24Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc64d5-619d-4a48-a742-451dd7e8a3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc64d5-619d-4a48-a742-451dd7e8a3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4477d536-b8b4-48db-b5a1-4cbe7c15c4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4477d536-b8b4-48db-b5a1-4cbe7c15c4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4271b16c-f71d-4205-8eb9-69e5cba3dde6', 'volume_name': 'volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b777d8-97b7-471c-8531-63805ab86cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b777d8-97b7-471c-8531-63805ab86cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc76e5c-0816-4954-b025-719f6dd34d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:24 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Volume 4271b16c-f71d-4205-8eb9-69e5cba3dde6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6', 'volume_size': 1}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:24 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3 1073741824" returned: 0 in 1.272s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:25 devstack sudo[91046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3
Apr 29 08:41:25 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (c7b6af56-b389-44d9-9378-c55e423214da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff111fa-76b7-4bed-9606-8ae5b5128900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff111fa-76b7-4bed-9606-8ae5b5128900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1939936687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e6f1ca-792c-4015-9a3a-726848c704b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:25Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950c42f0-8c22-4644-b232-129d52c9cfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950c42f0-8c22-4644-b232-129d52c9cfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4a5c05-b4a6-416c-bbb9-d2ce0f325ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4a5c05-b4a6-416c-bbb9-d2ce0f325ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e6f1ca-792c-4015-9a3a-726848c704b3', 'volume_name': 'volume-a8e6f1ca-792c-4015-9a3a-726848c704b3', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe2ba5a-8ebf-4721-a642-f1a9531eeeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe2ba5a-8ebf-4721-a642-f1a9531eeeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7697931-a66d-408e-85ad-20c871bafa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Volume a8e6f1ca-792c-4015-9a3a-726848c704b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e6f1ca-792c-4015-9a3a-726848c704b3', 'volume_size': 1}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185.35826c38-e210-4aec-bd70-fa96a88cf24d" returned: 0 in 1.059s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-35826c38-e210-4aec-bd70-fa96a88cf24d" released by "_delete_snapshot" :: held 4.329s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-91bfa42c-0232-4bbc-b111-674673220185" released by "delete_snapshot" :: held 4.375s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created reservations ['b378eae0-c8e0-4744-9ad9-15b06ca73333', '750dbb02-5028-412b-8e1e-ad6a0909b45e', 'b486f81c-2953-46c5-9ff4-bd2f92b6343f', 'e0497ed5-c9d6-4b38-8494-f2e8ce5d9cd0'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:25 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Delete snapshot completed successfully.
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05c8beee-ced1-42c3-b1b2-0420d88e0777 tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-35826c38-e210-4aec-bd70-fa96a88cf24d-delete_snapshot" released by "delete_snapshot" :: held 4.604s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (65794aeb-96ba-4bcd-bd14-ae6321f40202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8264a11d-1c35-47f5-8edf-d45b72fe7ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8264a11d-1c35-47f5-8edf-d45b72fe7ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184240687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9988b58b-2161-4240-aa26-4842c6928fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:25Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0d9359-3855-4108-a189-cc8e968e15fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0d9359-3855-4108-a189-cc8e968e15fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7615c9d2-1b22-4cd8-ba43-1bd9cdc46ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7615c9d2-1b22-4cd8-ba43-1bd9cdc46ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9988b58b-2161-4240-aa26-4842c6928fa6', 'volume_name': 'volume-9988b58b-2161-4240-aa26-4842c6928fa6', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f3f08d-6193-4b0c-9ab4-9f61597a3b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f3f08d-6193-4b0c-9ab4-9f61597a3b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d111b1eb-9be0-4a76-a025-c68704fda00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Volume 9988b58b-2161-4240-aa26-4842c6928fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9988b58b-2161-4240-aa26-4842c6928fa6', 'volume_size': 1}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:25 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3" returned: 0 in 0.764s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-678591877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cd9c3d-6ba0-4db5-8f5e-3476799ebc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:24Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Creating volume 49cd9c3d-6ba0-4db5-8f5e-3476799ebc56 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:25 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:25 devstack sudo[91051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56 1073741824
Apr 29 08:41:25 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2668eda-04d7-4b2b-bd75-4c465a995cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bcee9ca-b084-49c2-b9a6-0dceaab05fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:25 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Volume volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3 (8b628f51-1ae1-47c0-8020-60d28b1e07d3): created successfully
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bcee9ca-b084-49c2-b9a6-0dceaab05fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:25 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (33c4c093-bd6e-4b7b-a329-681d94105909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:25 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a086f6c3-faa6-4f36-be32-016affed365c tempest-CreateVolumesFromImageTest-1997195172 None] Created volume successfully.
Apr 29 08:41:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-91bfa42c-0232-4bbc-b111-674673220185-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-91bfa42c-0232-4bbc-b111-674673220185-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "cinder-quobyte-91bfa42c-0232-4bbc-b111-674673220185" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-91bfa42c-0232-4bbc-b111-674673220185" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:26 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[1602686e-af2e-4600-b0a1-938f2467a552]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:26 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185
Apr 29 08:41:26 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:26 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56 1073741824" returned: 0 in 0.946s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:26 devstack sudo[91058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56
Apr 29 08:41:26 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:27 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185" returned: 0 in 0.808s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:27 devstack sudo[91063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185
Apr 29 08:41:27 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:27 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56" returned: 0 in 0.675s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.812s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-187142131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4271b16c-f71d-4205-8eb9-69e5cba3dde6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:24Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Creating volume 4271b16c-f71d-4205-8eb9-69e5cba3dde6 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:27 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840b8056-f99e-486d-b09f-ef2ef2c22c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da86d99b-a547-40cc-9895-9c81cb51e3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:27 devstack sudo[91066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6 1073741824
Apr 29 08:41:27 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:27 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Volume volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56 (49cd9c3d-6ba0-4db5-8f5e-3476799ebc56): created successfully
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da86d99b-a547-40cc-9895-9c81cb51e3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (45f3df79-daad-4ad2-9637-35a88f136a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:27 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-69ec9783-1214-4b77-bafa-f146ab4f7c92 tempest-CreateVolumesFromImageTest-1997195172 None] Created volume successfully.
Apr 29 08:41:27 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-91bfa42c-0232-4bbc-b111-674673220185" returned: 0 in 0.745s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-quobyte-91bfa42c-0232-4bbc-b111-674673220185" released by "delete_volume" :: held 1.631s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Created reservations ['547dd6b5-bc4f-4221-a781-0586dea395f0', 'cbc23d89-a678-4a98-8382-cd0570e34b19', 'bcf5a7ea-6b38-4d3f-bd2c-adfcae050db3', '1d53d5f4-7abc-453b-92c0-f388fbb69e7a'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:27 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=144,cinder:DELETE=15,cinder:INSERT=61,cinder:UPDATE=225 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:28 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:28 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:28 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6 1073741824" returned: 0 in 0.975s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:28 devstack sudo[91075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6
Apr 29 08:41:28 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:28 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.753s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:28 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Deleted volume successfully.
Apr 29 08:41:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3a631c4c-be91-44a0-9ab5-c793ef73132a tempest-CreateVolumesFromSnapshotTest-1274037106 None] Lock "cinder-91bfa42c-0232-4bbc-b111-674673220185-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:29 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6" returned: 0 in 0.652s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.084s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Creating offline snapshot cb6d330a-b279-40c4-ab80-39b9747f996a of volume 6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc76e5c-0816-4954-b025-719f6dd34d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e9e426-d47b-497c-b882-bce13771ef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed99a10-7e23-46d2-9253-cce6c3580c17]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:29 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Volume volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6 (4271b16c-f71d-4205-8eb9-69e5cba3dde6): created successfully
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e9e426-d47b-497c-b882-bce13771ef42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (8490b0c8-dc1b-4439-9ef2-d0cd5ed3a792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-61afb035-5d73-4d49-8b04-18222129852f tempest-CreateVolumesFromImageTest-1997195172 None] Created volume successfully.
Apr 29 08:41:29 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871
Apr 29 08:41:29 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:30 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871" returned: 0 in 0.894s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6742fe33-26ff-49e5-b276-074e6430bba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:30 devstack sudo[91084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a 1G
Apr 29 08:41:30 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:30 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a 1G" returned: 0 in 0.850s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:30 devstack sudo[91090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a
Apr 29 08:41:30 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:31 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a" returned: 0 in 0.654s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:31 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a is being set with open permissions: ugo+rw
Apr 29 08:41:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:31 devstack sudo[91101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a
Apr 29 08:41:31 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:32 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a" returned: 0 in 0.633s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.167s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.126s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1939936687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e6f1ca-792c-4015-9a3a-726848c704b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:25Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Creating volume a8e6f1ca-792c-4015-9a3a-726848c704b3 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:32 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:32 devstack sudo[91104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3 1073741824
Apr 29 08:41:32 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:32 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-1f74e26a-d9e9-475e-8246-95d78b1e152f tempest-VolumesSnapshotListTestJSON-1998660905 None] Create snapshot completed successfully
Apr 29 08:41:33 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3 1073741824" returned: 0 in 0.885s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:33 devstack sudo[91110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3
Apr 29 08:41:33 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:33 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3" returned: 0 in 0.756s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.422s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184240687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9988b58b-2161-4240-aa26-4842c6928fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440d54a367e94144bf2b61728068c0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:25Z,use_quota=True,user_id='0acaae21456f48cd9adacd3001951b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Creating volume 9988b58b-2161-4240-aa26-4842c6928fa6 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:33 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:34 devstack sudo[91114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6 1073741824
Apr 29 08:41:34 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7697931-a66d-408e-85ad-20c871bafa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e6f1ca-792c-4015-9a3a-726848c704b3', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4991d56c-5837-4a8c-b84f-58102849a52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:34 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Volume volume-a8e6f1ca-792c-4015-9a3a-726848c704b3 (a8e6f1ca-792c-4015-9a3a-726848c704b3): created successfully
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4991d56c-5837-4a8c-b84f-58102849a52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (c7b6af56-b389-44d9-9378-c55e423214da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:34 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e4fa7351-7ecd-4706-ae05-850749c90615 tempest-CreateVolumesFromImageTest-1997195172 None] Created volume successfully.
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-cb6d330a-b279-40c4-ab80-39b9747f996a-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-cb6d330a-b279-40c4-ab80-39b9747f996a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-quobyte-cb6d330a-b279-40c4-ab80-39b9747f996a" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-cb6d330a-b279-40c4-ab80-39b9747f996a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Deleting offline snapshot cb6d330a-b279-40c4-ab80-39b9747f996a of volume 6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] snapshot_file for this snap is: volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e2ad85-fe85-408a-b6fe-2d7c2f04bc17]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:34 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a
Apr 29 08:41:34 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:34 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6 1073741824" returned: 0 in 0.998s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:35 devstack sudo[91122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6
Apr 29 08:41:35 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:35 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a" returned: 0 in 0.876s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6742fe33-26ff-49e5-b276-074e6430bba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[27972a70-2942-4da1-b632-ffe31ccbb369]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:35 devstack sudo[91128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871
Apr 29 08:41:35 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:35 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6" returned: 0 in 0.676s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d111b1eb-9be0-4a76-a025-c68704fda00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9988b58b-2161-4240-aa26-4842c6928fa6', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6627b64b-1214-4c0e-a8c0-cc842f2a0af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:35 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Volume volume-9988b58b-2161-4240-aa26-4842c6928fa6 (9988b58b-2161-4240-aa26-4842c6928fa6): created successfully
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6627b64b-1214-4c0e-a8c0-cc842f2a0af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:35 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Flow 'volume_create_manager' (65794aeb-96ba-4bcd-bd14-ae6321f40202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:35 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-13c58492-a7bb-435b-874b-2288564022e0 tempest-CreateVolumesFromImageTest-1997195172 None] Created volume successfully.
Apr 29 08:41:36 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871" returned: 0 in 0.798s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6742fe33-26ff-49e5-b276-074e6430bba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:36 devstack sudo[91134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a
Apr 29 08:41:36 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-9988b58b-2161-4240-aa26-4842c6928fa6-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-9988b58b-2161-4240-aa26-4842c6928fa6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-quobyte-9988b58b-2161-4240-aa26-4842c6928fa6" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-9988b58b-2161-4240-aa26-4842c6928fa6" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:36 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3c19e6-2449-402c-add4-d9eae3489c25]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:36 devstack sudo[91136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6
Apr 29 08:41:36 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:37 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a" returned: 0 in 1.026s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:37 devstack sudo[91142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a
Apr 29 08:41:37 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:37 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6" returned: 0 in 0.865s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:37 devstack sudo[91147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6
Apr 29 08:41:37 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:37 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.cb6d330a-b279-40c4-ab80-39b9747f996a" returned: 0 in 0.871s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-cb6d330a-b279-40c4-ab80-39b9747f996a" released by "_delete_snapshot" :: held 3.718s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" released by "delete_snapshot" :: held 3.751s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Created reservations ['b9013804-ed42-4a8c-beb6-678b2f86d740', 'f832e28b-8338-43f5-98ae-1e9b940662ff', '9c363358-ec28-4b71-acbd-1bfa38e5e167', 'daddfbcd-bbfc-42d4-be21-5f9a39a5a30c'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:38 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Delete snapshot completed successfully.
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c3365797-d7e1-47fa-a518-0328c500793a tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-cb6d330a-b279-40c4-ab80-39b9747f996a-delete_snapshot" released by "delete_snapshot" :: held 3.966s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:38 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9988b58b-2161-4240-aa26-4842c6928fa6" returned: 0 in 0.769s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-9988b58b-2161-4240-aa26-4842c6928fa6" released by "delete_volume" :: held 1.689s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Created reservations ['491ce038-c6e3-46fd-88c1-b48ead79bfe2', '8edf6a73-54b3-40b5-a4a0-44644432a25c', '385f23e2-e1f3-4a5d-ac8a-591db720cccd', 'd58abb59-3f56-4a65-9724-804a8fa85da2'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:38 devstack sudo[91151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:38 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-b24cc74b-d461-41ec-8e61-b251aa6d2871-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-b24cc74b-d461-41ec-8e61-b251aa6d2871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-quobyte-b24cc74b-d461-41ec-8e61-b251aa6d2871" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-b24cc74b-d461-41ec-8e61-b251aa6d2871" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Deleting offline snapshot b24cc74b-d461-41ec-8e61-b251aa6d2871 of volume 6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] snapshot_file for this snap is: volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[46da4b1f-2192-425b-a082-cecadd803bd5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:38 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871
Apr 29 08:41:38 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-a8e6f1ca-792c-4015-9a3a-726848c704b3-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-a8e6f1ca-792c-4015-9a3a-726848c704b3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-quobyte-a8e6f1ca-792c-4015-9a3a-726848c704b3" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-a8e6f1ca-792c-4015-9a3a-726848c704b3" acquired by "delete_volume" :: waited 0.031s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fc3c3a-38a1-48ec-9b65-4361caa1f0bc]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:39 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.793s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:39 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Deleted volume successfully.
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-24c5f840-18e8-4d40-9982-63ad9883593c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-9988b58b-2161-4240-aa26-4842c6928fa6-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:39 devstack sudo[91156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3
Apr 29 08:41:39 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:39 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871" returned: 0 in 1.028s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6742fe33-26ff-49e5-b276-074e6430bba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfa1096-054a-4744-b152-ce0321ae9cfc]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:39 devstack sudo[91161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1
Apr 29 08:41:39 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:40 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3" returned: 0 in 0.852s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:40 devstack sudo[91166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3
Apr 29 08:41:40 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:40 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1" returned: 0 in 0.834s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6742fe33-26ff-49e5-b276-074e6430bba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:40 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871
Apr 29 08:41:40 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:40 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-a8e6f1ca-792c-4015-9a3a-726848c704b3" returned: 0 in 0.625s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-a8e6f1ca-792c-4015-9a3a-726848c704b3" released by "delete_volume" :: held 1.555s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Created reservations ['b4ee5d45-3914-4e1c-9263-d16b0c1770ef', 'c7259af0-cc55-48c6-bf6b-9fd48b41b4de', 'fd90cfb6-f3eb-4555-b26e-5b444db4e6a9', 'abe723fb-9d63-4020-afe8-344fbae9130a'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:40 devstack sudo[91174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:40 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-4271b16c-f71d-4205-8eb9-69e5cba3dde6-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-4271b16c-f71d-4205-8eb9-69e5cba3dde6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-quobyte-4271b16c-f71d-4205-8eb9-69e5cba3dde6" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-4271b16c-f71d-4205-8eb9-69e5cba3dde6" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4e0df8-fc9b-4cf3-b6c6-136af09cab31]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:41 devstack sudo[91180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6
Apr 29 08:41:41 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:41 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871" returned: 0 in 1.027s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:41 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.822s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:41 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Deleted volume successfully.
Apr 29 08:41:41 devstack sudo[91183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871
Apr 29 08:41:41 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4dbd26dc-9824-4bf0-b09b-e4cf9a4bf682 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-a8e6f1ca-792c-4015-9a3a-726848c704b3-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:42 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6" returned: 0 in 0.814s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:42 devstack sudo[91189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6
Apr 29 08:41:42 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:42 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Flow 'volume_create_manager' (65e7a433-c1eb-460d-adf2-14d4ed293210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d18f0c1-c05e-4b85-9e22-b50fddac63a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.b24cc74b-d461-41ec-8e61-b251aa6d2871" returned: 0 in 0.699s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d18f0c1-c05e-4b85-9e22-b50fddac63a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1362607016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ddee98-e328-48d7-b8b9-ccfae0ef0d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c675fd546ad4d91b3f6d94a7142727f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:42Z,use_quota=True,user_id='ca9b44d83e6e45ce8f9c8bccc25794d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07d94be-349d-439b-8edf-b3cba8acbb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07d94be-349d-439b-8edf-b3cba8acbb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d76bca1-bafd-4607-b29a-767e9a84259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d76bca1-bafd-4607-b29a-767e9a84259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ddee98-e328-48d7-b8b9-ccfae0ef0d2a', 'volume_name': 'volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea01a0ea-1982-4482-85bf-c6b584805939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea01a0ea-1982-4482-85bf-c6b584805939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293450ad-42f8-4351-806a-27f9cfc47b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:42 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Volume 56ddee98-e328-48d7-b8b9-ccfae0ef0d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a', 'volume_size': 1}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1362607016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ddee98-e328-48d7-b8b9-ccfae0ef0d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c675fd546ad4d91b3f6d94a7142727f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:42Z,use_quota=True,user_id='ca9b44d83e6e45ce8f9c8bccc25794d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Creating volume 56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:42 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-b24cc74b-d461-41ec-8e61-b251aa6d2871" released by "_delete_snapshot" :: held 3.786s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" released by "delete_snapshot" :: held 3.830s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:42 devstack sudo[91191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a 1073741824
Apr 29 08:41:42 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Created reservations ['554b9a60-54e8-4bbd-bb46-df02c565c352', '063fe0a3-c385-4160-8886-4a26afb41543', '63c5896d-f15d-41cf-b98e-160a325d475a', 'bdb751ca-ef9c-4def-ab2a-d466f0657056'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Delete snapshot completed successfully.
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6a9f0199-0f2c-40d7-be71-2524a73c240e tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-b24cc74b-d461-41ec-8e61-b251aa6d2871-delete_snapshot" released by "delete_snapshot" :: held 3.980s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-eaf0e449-7a72-406c-9ffa-80dfde7d72a1-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-eaf0e449-7a72-406c-9ffa-80dfde7d72a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-quobyte-eaf0e449-7a72-406c-9ffa-80dfde7d72a1" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:42 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4271b16c-f71d-4205-8eb9-69e5cba3dde6" returned: 0 in 0.661s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-4271b16c-f71d-4205-8eb9-69e5cba3dde6" released by "delete_volume" :: held 1.524s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-eaf0e449-7a72-406c-9ffa-80dfde7d72a1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Deleting offline snapshot eaf0e449-7a72-406c-9ffa-80dfde7d72a1 of volume 6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] snapshot_file for this snap is: volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[83168eca-6240-4f3d-80b3-3709a6140431]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Created reservations ['3d09533d-dbce-4893-8cbb-6ed3b03bbbce', '121e626c-b2b3-41d2-9a9b-644680e5ec10', '91cc301c-7f94-40df-a33b-da45e6bbe130', '6b0bba72-f44b-457a-9f4a-99a7ed5e82bd'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:43 devstack sudo[91195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1
Apr 29 08:41:43 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:43 devstack sudo[91199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:43 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:43 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a 1073741824" returned: 0 in 0.890s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:43 devstack sudo[91203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a
Apr 29 08:41:43 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-quobyte-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56" acquired by "delete_volume" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c477c3-0b55-424e-b1b8-566ef6268246]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:43 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.707s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:43 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Deleted volume successfully.
Apr 29 08:41:43 devstack sudo[91209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56
Apr 29 08:41:43 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:43 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1" returned: 0 in 0.865s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6742fe33-26ff-49e5-b276-074e6430bba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6db7668f-bb7e-4652-ac52-230c518f294c tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-4271b16c-f71d-4205-8eb9-69e5cba3dde6-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[904d55b0-de65-46a0-8822-921350ed4774]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:43 devstack sudo[91211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7
Apr 29 08:41:43 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:44 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" returned: 0 in 0.738s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293450ad-42f8-4351-806a-27f9cfc47b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525e60f9-29c3-426c-bdcf-8612ab1ba25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:44 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Volume volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a (56ddee98-e328-48d7-b8b9-ccfae0ef0d2a): created successfully
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525e60f9-29c3-426c-bdcf-8612ab1ba25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Flow 'volume_create_manager' (65e7a433-c1eb-460d-adf2-14d4ed293210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:44 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d3acd13d-d4ec-4e98-874c-df83336b2ce3 tempest-VolumesActionsTest-1932641639 None] Created volume successfully.
Apr 29 08:41:44 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56" returned: 0 in 0.771s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:44 devstack sudo[91217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56
Apr 29 08:41:44 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:44 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7" returned: 0 in 0.779s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:44 devstack sudo[91222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1
Apr 29 08:41:44 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:45 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56" returned: 0 in 0.650s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56" released by "delete_volume" :: held 1.468s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Created reservations ['b957add6-5396-4f21-b1d9-65621ce7c51b', '58a588a6-a638-4e85-b0c1-d4845cd5c2c0', 'a3953637-4825-437f-bbc6-52110794e4d7', 'f1df5ffa-619e-4122-b336-a4c77da45d79'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:45 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1" returned: 0 in 0.758s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:45 devstack sudo[91229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1
Apr 29 08:41:45 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:45 devstack sudo[91233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:45 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-8b628f51-1ae1-47c0-8020-60d28b1e07d3-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-8b628f51-1ae1-47c0-8020-60d28b1e07d3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "cinder-quobyte-8b628f51-1ae1-47c0-8020-60d28b1e07d3" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-8b628f51-1ae1-47c0-8020-60d28b1e07d3" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35d7588-95a6-433e-981d-0184cab0e647]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:46 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7.eaf0e449-7a72-406c-9ffa-80dfde7d72a1" returned: 0 in 0.721s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:46 devstack sudo[91236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3
Apr 29 08:41:46 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-eaf0e449-7a72-406c-9ffa-80dfde7d72a1" released by "_delete_snapshot" :: held 3.276s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" released by "delete_snapshot" :: held 3.319s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Created reservations ['14f6cfa9-dfab-4bad-bf67-340579b728ce', '96acc716-fa16-4ccd-8f52-0ea07d90aa06', '1dc67632-fa09-4ad2-aad7-71f654c329b2', '9eb545d8-27a1-4b4e-96b8-fce5d702f71a'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:46 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.803s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:46 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Deleted volume successfully.
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d595f33d-b951-44b6-9ad8-0124e2eeb025 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-49cd9c3d-6ba0-4db5-8f5e-3476799ebc56-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:46 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Delete snapshot completed successfully.
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f9e36620-6273-42ed-a324-2a2f65620b7b tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-eaf0e449-7a72-406c-9ffa-80dfde7d72a1-delete_snapshot" released by "delete_snapshot" :: held 3.610s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:46 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3" returned: 0 in 0.867s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:46 devstack sudo[91242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3
Apr 29 08:41:46 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-6742fe33-26ff-49e5-b276-074e6430bba7-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-6742fe33-26ff-49e5-b276-074e6430bba7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" acquired by "delete_volume" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[632091c9-45bb-4deb-b96f-e79ec5483e6d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:47 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7
Apr 29 08:41:47 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:47 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-8b628f51-1ae1-47c0-8020-60d28b1e07d3" returned: 0 in 0.613s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-quobyte-8b628f51-1ae1-47c0-8020-60d28b1e07d3" released by "delete_volume" :: held 1.550s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Created reservations ['64159b10-3a4c-46a0-b513-c90397525ad3', 'c95460bf-6f1b-426e-ad49-368e3ce71480', '5e680e3a-d335-4a59-8952-b29813f85c6a', '78b52b37-be62-4072-b16c-4de25b152b53'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:47 devstack sudo[91247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:47 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:48 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7" returned: 0 in 0.775s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:48 devstack sudo[91252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7
Apr 29 08:41:48 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:48 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.694s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:48 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Deleted volume successfully.
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-baed0eb1-8455-4ce2-9bc1-ea626140ca43 tempest-CreateVolumesFromImageTest-1997195172 None] Lock "cinder-8b628f51-1ae1-47c0-8020-60d28b1e07d3-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:48 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6742fe33-26ff-49e5-b276-074e6430bba7" returned: 0 in 0.699s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-quobyte-6742fe33-26ff-49e5-b276-074e6430bba7" released by "delete_volume" :: held 1.539s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Created reservations ['6aafb40f-8cb6-46f3-b476-8f9e4af33272', '93c016c2-7fa4-4d6e-b2ee-cd2320f28572', 'db1d4365-639e-400d-b541-527188aae1ff', 'cf2ea603-8f17-4329-9f93-0980b81f3a07'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:48 devstack sudo[91256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:48 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:49 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.675s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:49 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Deleted volume successfully.
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-76ca4a87-3b92-446c-9974-8cc5d2dfae58 tempest-VolumesSnapshotListTestJSON-1998660905 None] Lock "cinder-6742fe33-26ff-49e5-b276-074e6430bba7-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:49 devstack sudo[91259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:41:49 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:50 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.775s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (3619289a-adf3-4fbb-8837-ec4d9fe4b53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ed7418-fe68-4e13-9a30-11af1a532adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ed7418-fe68-4e13-9a30-11af1a532adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1856846759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f0817b-6f15-4492-9af8-249e09f1c519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:51Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30e237f-f898-4a7b-81de-767e228c05d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30e237f-f898-4a7b-81de-767e228c05d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89021b58-b51f-43d5-a26d-aa4ea891c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89021b58-b51f-43d5-a26d-aa4ea891c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f0817b-6f15-4492-9af8-249e09f1c519', 'volume_name': 'volume-02f0817b-6f15-4492-9af8-249e09f1c519', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39033fdf-28e8-4491-b8c1-44248ceb6410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39033fdf-28e8-4491-b8c1-44248ceb6410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533e1011-76a3-4d3b-89f9-196c5ae8dfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume 02f0817b-6f15-4492-9af8-249e09f1c519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f0817b-6f15-4492-9af8-249e09f1c519', 'volume_size': 1}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1856846759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f0817b-6f15-4492-9af8-249e09f1c519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:51Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Creating volume 02f0817b-6f15-4492-9af8-249e09f1c519 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:51 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:51 devstack sudo[91262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519 1073741824
Apr 29 08:41:51 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:52 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519 1073741824" returned: 0 in 0.885s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:52 devstack sudo[91275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519
Apr 29 08:41:52 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:53 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519" returned: 0 in 0.668s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533e1011-76a3-4d3b-89f9-196c5ae8dfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f0817b-6f15-4492-9af8-249e09f1c519', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64ea6bd-374f-4be0-9d80-619d86e0386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:53 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume volume-02f0817b-6f15-4492-9af8-249e09f1c519 (02f0817b-6f15-4492-9af8-249e09f1c519): created successfully
Apr 29 08:41:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64ea6bd-374f-4be0-9d80-619d86e0386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (3619289a-adf3-4fbb-8837-ec4d9fe4b53e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:53 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4321658a-312a-429e-a019-980edaeec9a4 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created volume successfully.
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (7f6f7991-e924-427c-ad9d-6363f15adaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4014b1f1-8e58-42b2-a17d-80d3bb160294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4014b1f1-8e58-42b2-a17d-80d3bb160294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1920691054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:54Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69d2298-a297-49b1-967a-129b4ded4327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69d2298-a297-49b1-967a-129b4ded4327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f973610-95cb-44fe-9a21-01fe7b95ebf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f973610-95cb-44fe-9a21-01fe7b95ebf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9', 'volume_name': 'volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3bd79d-f69e-4e91-af55-60aaaa029113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3bd79d-f69e-4e91-af55-60aaaa029113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f2a7c5-dd0d-4e38-8eb0-e5733df086e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume 1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9', 'volume_size': 1}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1920691054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:54Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Creating volume 1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:54 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:54 devstack sudo[91288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9 1073741824
Apr 29 08:41:54 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (ee9bbba6-9567-4a29-9751-cc395ddde583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94b4bc6-904f-4f27-a99d-bd5a058f7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94b4bc6-904f-4f27-a99d-bd5a058f7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668157809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de3573d-702f-47d2-be3d-06a468daae89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:54Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0972a6f7-c249-49b2-8491-36a653d86248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0972a6f7-c249-49b2-8491-36a653d86248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3417a10-e10d-47ac-b609-27b49f8e6d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3417a10-e10d-47ac-b609-27b49f8e6d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de3573d-702f-47d2-be3d-06a468daae89', 'volume_name': 'volume-9de3573d-702f-47d2-be3d-06a468daae89', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122c2db2-4291-45e8-8b21-49809bd4de02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122c2db2-4291-45e8-8b21-49809bd4de02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87800164-0d06-4869-8d37-b45424f13ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume 9de3573d-702f-47d2-be3d-06a468daae89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de3573d-702f-47d2-be3d-06a468daae89', 'volume_size': 1}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (e34e797f-68a9-427c-b870-ca3a27db50ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e815e0-0fa8-4f1a-b75e-6ff291c13767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e815e0-0fa8-4f1a-b75e-6ff291c13767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-253114907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad1c967-7a3b-4521-9e3f-97933d1b6995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:55Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6b97ab-50ad-444a-9d17-44f5ff983456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6b97ab-50ad-444a-9d17-44f5ff983456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac5e09a-2335-48b1-8eec-19b25ee2f8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac5e09a-2335-48b1-8eec-19b25ee2f8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad1c967-7a3b-4521-9e3f-97933d1b6995', 'volume_name': 'volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332450f9-00e4-4406-9408-d1b995bb1387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332450f9-00e4-4406-9408-d1b995bb1387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5128348-874f-4fb3-9bba-630987125a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume 4ad1c967-7a3b-4521-9e3f-97933d1b6995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995', 'volume_size': 1}
Apr 29 08:41:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:55 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9 1073741824" returned: 0 in 0.996s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:55 devstack sudo[91294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9
Apr 29 08:41:55 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (5dc05077-1be9-4ee5-bf96-ff8ab5d5c650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eac6296-fa44-45dd-b281-f7a38923e228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eac6296-fa44-45dd-b281-f7a38923e228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-198402083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:55Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed22e1d4-9c36-4521-9af8-8373a4bb2500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed22e1d4-9c36-4521-9af8-8373a4bb2500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b46156-dde5-42fb-ac25-b0f2e48c640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b46156-dde5-42fb-ac25-b0f2e48c640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87', 'volume_name': 'volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e96f05-1c5c-4e40-95ce-7c17e0553f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e96f05-1c5c-4e40-95ce-7c17e0553f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d014274-e197-4945-a9eb-e07653f3c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume 2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87', 'volume_size': 1}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (b648102d-a435-49aa-9d49-764825a58656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d7ccbd-dd33-4bed-99d6-7d441beb40ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d7ccbd-dd33-4bed-99d6-7d441beb40ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133706760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ef7f96-94f5-4a39-8a41-32b6d52883fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:56Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f7af48-09e9-43fb-a5c6-b4e7bc1bfcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f7af48-09e9-43fb-a5c6-b4e7bc1bfcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd6570-4b0c-4ce6-a849-b7a62938beed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd6570-4b0c-4ce6-a849-b7a62938beed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8ef7f96-94f5-4a39-8a41-32b6d52883fc', 'volume_name': 'volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a9d2ca-abff-4aad-a9df-c542d4661f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a9d2ca-abff-4aad-a9df-c542d4661f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7fb85f-efd4-4343-8ab0-06e69d9818da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume f8ef7f96-94f5-4a39-8a41-32b6d52883fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc', 'volume_size': 1}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:55 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9" returned: 0 in 0.705s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668157809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de3573d-702f-47d2-be3d-06a468daae89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:54Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Creating volume 9de3573d-702f-47d2-be3d-06a468daae89 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:55 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:55 devstack sudo[91300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89 1073741824
Apr 29 08:41:55 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f2a7c5-dd0d-4e38-8eb0-e5733df086e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fa796e-e74d-432d-bd99-7ad74aa613f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:56 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9 (1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9): created successfully
Apr 29 08:41:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fa796e-e74d-432d-bd99-7ad74aa613f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:56 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (7f6f7991-e924-427c-ad9d-6363f15adaf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ca59be14-eb85-4925-b8f2-65739d4c1940 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created volume successfully.
Apr 29 08:41:56 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89 1073741824" returned: 0 in 0.741s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:56 devstack sudo[91305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89
Apr 29 08:41:56 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:57 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89" returned: 0 in 0.590s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.349s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-253114907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad1c967-7a3b-4521-9e3f-97933d1b6995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:55Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Creating volume 4ad1c967-7a3b-4521-9e3f-97933d1b6995 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:57 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87800164-0d06-4869-8d37-b45424f13ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de3573d-702f-47d2-be3d-06a468daae89', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:57 devstack sudo[91308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995 1073741824
Apr 29 08:41:57 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db341522-82d4-47f8-ae3c-2d46fa920b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:57 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume volume-9de3573d-702f-47d2-be3d-06a468daae89 (9de3573d-702f-47d2-be3d-06a468daae89): created successfully
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db341522-82d4-47f8-ae3c-2d46fa920b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:57 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (ee9bbba6-9567-4a29-9751-cc395ddde583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5c162173-4b95-49e7-a966-68c85f5976ef tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created volume successfully.
Apr 29 08:41:58 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995 1073741824" returned: 0 in 1.175s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:58 devstack sudo[91375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995
Apr 29 08:41:58 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:59 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995" returned: 0 in 0.617s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.764s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-198402083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:55Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Creating volume 2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:59 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5128348-874f-4fb3-9bba-630987125a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:59 devstack sudo[91379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87 1073741824
Apr 29 08:41:59 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cbcc46-2f83-4e44-bda5-4961124cf1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:59 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995 (4ad1c967-7a3b-4521-9e3f-97933d1b6995): created successfully
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cbcc46-2f83-4e44-bda5-4961124cf1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (e34e797f-68a9-427c-b870-ca3a27db50ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:59 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c0ff084a-790b-472f-a87b-ccd4aca060b3 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created volume successfully.
Apr 29 08:42:00 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87 1073741824" returned: 0 in 0.922s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:00 devstack sudo[91385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87
Apr 29 08:42:00 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:00 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87" returned: 0 in 0.679s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.077s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133706760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ef7f96-94f5-4a39-8a41-32b6d52883fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb5898ab6834e43aadd3f0975f0c7b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:56Z,use_quota=True,user_id='0dc61834bca24b1b8dae7755a7a0ccbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Creating volume f8ef7f96-94f5-4a39-8a41-32b6d52883fc {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:00 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d014274-e197-4945-a9eb-e07653f3c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4f9662-da90-45dd-a532-feae113d03a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:00 devstack sudo[91389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc 1073741824
Apr 29 08:42:00 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:00 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87 (2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87): created successfully
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4f9662-da90-45dd-a532-feae113d03a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (5dc05077-1be9-4ee5-bf96-ff8ab5d5c650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:00 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ac2fbaac-5ebe-4f32-9a30-92a630d18717 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created volume successfully.
Apr 29 08:42:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-55a6c1d5-3705-497a-99b6-e73ee91014a0 tempest-VolumesActionsTest-1932641639 None] Acquiring lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" by "attach_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-55a6c1d5-3705-497a-99b6-e73ee91014a0 tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" acquired by "attach_volume" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-55a6c1d5-3705-497a-99b6-e73ee91014a0 tempest-VolumesActionsTest-1932641639 None] Attaching volume 56ddee98-e328-48d7-b8b9-ccfae0ef0d2a to instance 6c2b09c7-202e-421b-a8d2-61a2e8d8c85f at mountpoint /dev/vdb on host None.
Apr 29 08:42:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-55a6c1d5-3705-497a-99b6-e73ee91014a0 tempest-VolumesActionsTest-1932641639 None] Attach volume completed successfully.
Apr 29 08:42:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-55a6c1d5-3705-497a-99b6-e73ee91014a0 tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" released by "attach_volume" :: held 0.135s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5a92e668-459b-41d9-8424-8a89a2069b0e tempest-VolumesActionsTest-1932641639 None] Acquiring lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a-detach_volume" by "detach_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5a92e668-459b-41d9-8424-8a89a2069b0e tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5a92e668-459b-41d9-8424-8a89a2069b0e tempest-VolumesActionsTest-1932641639 None] Detaching volume 56ddee98-e328-48d7-b8b9-ccfae0ef0d2a from instance 6c2b09c7-202e-421b-a8d2-61a2e8d8c85f.
Apr 29 08:42:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5a92e668-459b-41d9-8424-8a89a2069b0e tempest-VolumesActionsTest-1932641639 None] Detach volume completed successfully.
Apr 29 08:42:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-5a92e668-459b-41d9-8424-8a89a2069b0e tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:01 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc 1073741824" returned: 0 in 1.041s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:01 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc
Apr 29 08:42:01 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:02 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc" returned: 0 in 0.633s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7fb85f-efd4-4343-8ab0-06e69d9818da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230b4e04-9d1f-4af1-9417-76b4f7fe5e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:02 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Volume volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc (f8ef7f96-94f5-4a39-8a41-32b6d52883fc): created successfully
Apr 29 08:42:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230b4e04-9d1f-4af1-9417-76b4f7fe5e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Flow 'volume_create_manager' (b648102d-a435-49aa-9d49-764825a58656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e7fb904a-bf87-44ea-9625-195778222877 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created volume successfully.
Apr 29 08:42:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-f8ef7f96-94f5-4a39-8a41-32b6d52883fc-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-f8ef7f96-94f5-4a39-8a41-32b6d52883fc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-quobyte-f8ef7f96-94f5-4a39-8a41-32b6d52883fc" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-f8ef7f96-94f5-4a39-8a41-32b6d52883fc" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:03 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b28b3c-f6d5-4c54-b756-f888a3f6148d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:03 devstack sudo[91434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc
Apr 29 08:42:03 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:04 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc" returned: 0 in 0.763s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:04 devstack sudo[91446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc
Apr 29 08:42:04 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:05 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f8ef7f96-94f5-4a39-8a41-32b6d52883fc" returned: 0 in 0.584s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-f8ef7f96-94f5-4a39-8a41-32b6d52883fc" released by "delete_volume" :: held 1.439s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created reservations ['fdebcc10-34b0-49f6-b801-d647e08275df', '9ebac21c-062b-4218-a1f8-e38cf32eeb87', '7c402062-8d04-4959-b9bb-61bbeee11d17', '9892f4f0-d437-4bd7-84b6-4dee17ff832d'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:05 devstack sudo[91449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:42:05 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-quobyte-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e37e24d-6178-4bd6-8884-ad89c0c950b2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:06 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.662s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:06 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Deleted volume successfully.
Apr 29 08:42:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c4f668e4-5165-44b3-8c7f-97abf88164fd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-f8ef7f96-94f5-4a39-8a41-32b6d52883fc-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:06 devstack sudo[91454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87
Apr 29 08:42:06 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:06 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87" returned: 0 in 0.741s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:06 devstack sudo[91459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87
Apr 29 08:42:06 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:07 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87" returned: 0 in 0.621s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87" released by "delete_volume" :: held 1.407s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:07 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created reservations ['da1eacc6-1c0d-4d2c-ac66-34ce4592a7af', '5108aaa4-47fc-4d9e-933a-e0641166b8e5', '055a0140-613e-406c-9c64-3ce56a071613', '497dabbf-cad6-4f71-9d75-593a844c3906'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:07 devstack sudo[91462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:42:07 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:08 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.624s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:08 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Deleted volume successfully.
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f79a7c4d-2791-4214-a777-975007bb88bd tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-2f3ee9e9-4bdd-4b94-b5bf-ad781ecb4a87-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-4ad1c967-7a3b-4521-9e3f-97933d1b6995-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-4ad1c967-7a3b-4521-9e3f-97933d1b6995-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-quobyte-4ad1c967-7a3b-4521-9e3f-97933d1b6995" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-4ad1c967-7a3b-4521-9e3f-97933d1b6995" acquired by "delete_volume" :: waited 0.013s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[1776e1c0-2564-485d-9d6b-2d9e5f255f88]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:08 devstack sudo[91465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995
Apr 29 08:42:08 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:08 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995" returned: 0 in 0.736s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:09 devstack sudo[91470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995
Apr 29 08:42:09 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:09 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4ad1c967-7a3b-4521-9e3f-97933d1b6995" returned: 0 in 0.601s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-4ad1c967-7a3b-4521-9e3f-97933d1b6995" released by "delete_volume" :: held 1.381s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:09 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created reservations ['864dd08f-d74c-4882-b02d-148064a47c22', '75c59ac2-4a60-4606-aad3-1d8dca6f417b', 'c272f48c-6c23-46d4-9b86-50bd7a01ee92', '7934cb56-71c8-47a1-890a-e73aa4f5694b'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:09 devstack sudo[91473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:42:09 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:10 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.642s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:10 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:10 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Deleted volume successfully.
Apr 29 08:42:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-9de3573d-702f-47d2-be3d-06a468daae89-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7161225b-3b06-4a46-98b3-97c4523907f8 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-4ad1c967-7a3b-4521-9e3f-97933d1b6995-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-9de3573d-702f-47d2-be3d-06a468daae89-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-quobyte-9de3573d-702f-47d2-be3d-06a468daae89" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:10 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-9de3573d-702f-47d2-be3d-06a468daae89" acquired by "delete_volume" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:10 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a7a0db-6acd-4167-9e1d-fab192c099fb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:10 devstack sudo[91476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89
Apr 29 08:42:10 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:11 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89" returned: 0 in 0.839s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:11 devstack sudo[91485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89
Apr 29 08:42:11 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:11 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9de3573d-702f-47d2-be3d-06a468daae89" returned: 0 in 0.612s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-9de3573d-702f-47d2-be3d-06a468daae89" released by "delete_volume" :: held 1.494s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created reservations ['8b85edff-793f-4012-98b9-daca7c5e2417', '00c07cca-35a1-4f04-80ce-504cb7e90f0e', '0ad997da-e113-4927-9b58-35752b8f43d9', '60c89d82-0542-41cb-931f-66f1582e0174'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:12 devstack sudo[91488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:42:12 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:12 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.628s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-quobyte-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:12 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Deleted volume successfully.
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e8bb7b58-549a-4072-8efa-ffde85c3c2b2 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-9de3573d-702f-47d2-be3d-06a468daae89-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a255bf-ec4f-47d2-9f3e-988686a20b71]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:12 devstack sudo[91491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9
Apr 29 08:42:12 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:13 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9" returned: 0 in 0.728s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:13 devstack sudo[91497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9
Apr 29 08:42:13 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:14 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9" returned: 0 in 0.596s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9" released by "delete_volume" :: held 1.365s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created reservations ['7f55e587-13ae-4eb2-ac43-33995801a198', 'd6f6ac47-90e1-411a-a4f4-f6b6cd1ac2bb', '5eea5d6b-0f81-40d1-b7df-8793c88dee40', 'a0f555fc-df1a-4985-bda9-052124c45782'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:14 devstack sudo[91500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:42:14 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:14 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.600s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:14 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Deleted volume successfully.
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-67d24547-18d0-427e-851c-3cbf0c01a555 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-1c0e78a2-1113-4d89-a7dd-ffcc7bf5aff9-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-02f0817b-6f15-4492-9af8-249e09f1c519-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-02f0817b-6f15-4492-9af8-249e09f1c519-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "cinder-quobyte-02f0817b-6f15-4492-9af8-249e09f1c519" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-02f0817b-6f15-4492-9af8-249e09f1c519" acquired by "delete_volume" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:15 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e01000-07a8-40e6-98f9-d56ec6dc2534]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:15 devstack sudo[91503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519
Apr 29 08:42:15 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:15 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519" returned: 0 in 0.735s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:15 devstack sudo[91508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519
Apr 29 08:42:15 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:16 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-02f0817b-6f15-4492-9af8-249e09f1c519" returned: 0 in 0.592s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-quobyte-02f0817b-6f15-4492-9af8-249e09f1c519" released by "delete_volume" :: held 1.370s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:16 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Created reservations ['20573b9c-112b-4253-b719-9d2ce6360598', 'e625b344-9279-41ec-a5d9-dc7b3c59f8d6', 'feec7888-1487-4dac-b136-11df33d12b67', 'e6d7ce84-24f1-4f5e-b920-0f084b0a3699'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:16 devstack sudo[91511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:42:16 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:17 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.608s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:17 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:17 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Deleted volume successfully.
Apr 29 08:42:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4bc5feb1-9ff8-4f23-9dc9-80c1a130eac9 tempest-CreateVolumesFromSourceVolumeTest-1181044313 None] Lock "cinder-02f0817b-6f15-4492-9af8-249e09f1c519-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:DELETE=18,cinder:UPDATE=203,cinder:SELECT=148,cinder:INSERT=50 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Flow 'volume_create_manager' (b01dd779-e782-40b7-8bfc-a89a5d24beee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb2592e-9725-475f-bd7b-e14c671e7ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb2592e-9725-475f-bd7b-e14c671e7ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1628584081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4e6d35-fef7-4005-92a0-10fa779c5a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ae0164134b4a059b71992a607b1ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:20Z,use_quota=True,user_id='0e8d78e9ee094b23a381896f81e6650b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb159f77-138e-4f3f-a7c3-0f9835862db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb159f77-138e-4f3f-a7c3-0f9835862db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72708dce-8c67-4b65-be94-4316bc5da8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72708dce-8c67-4b65-be94-4316bc5da8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d4e6d35-fef7-4005-92a0-10fa779c5a3a', 'volume_name': 'volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c20f4c8-a1ef-4c34-9c29-78c631da9a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c20f4c8-a1ef-4c34-9c29-78c631da9a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b98889-3758-4f3f-9449-0c93b4c88c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:20 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Volume 5d4e6d35-fef7-4005-92a0-10fa779c5a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a', 'volume_size': 1}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1628584081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4e6d35-fef7-4005-92a0-10fa779c5a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ae0164134b4a059b71992a607b1ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:20Z,use_quota=True,user_id='0e8d78e9ee094b23a381896f81e6650b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Creating volume 5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:20 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:42:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:20 devstack sudo[91534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a 1073741824
Apr 29 08:42:20 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:21 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a 1073741824" returned: 0 in 0.789s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:21 devstack sudo[91540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a
Apr 29 08:42:21 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:21 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" returned: 0 in 0.588s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b98889-3758-4f3f-9449-0c93b4c88c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db87940e-15e2-468c-8950-9d0e761f0dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:21 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Volume volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a (5d4e6d35-fef7-4005-92a0-10fa779c5a3a): created successfully
Apr 29 08:42:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db87940e-15e2-468c-8950-9d0e761f0dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Flow 'volume_create_manager' (b01dd779-e782-40b7-8bfc-a89a5d24beee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:21 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6aa2f459-78cf-4308-9aa2-aa0396491bf3 tempest-VolumeDependencyTests-1355392568 None] Created volume successfully.
Apr 29 08:42:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Creating offline snapshot 5bd03436-b36d-49f2-86a0-5254f448e2cb of volume 5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:42:22 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0926f5c-c2b3-4613-bdc5-cedaaa076b0c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:22 devstack sudo[91583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a
Apr 29 08:42:22 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:23 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" returned: 0 in 0.702s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:23 devstack sudo[91589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb 1G
Apr 29 08:42:23 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:24 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb 1G" returned: 0 in 1.162s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:24 devstack sudo[91654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb
Apr 29 08:42:24 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:25 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb" returned: 0 in 0.760s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:25 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb is being set with open permissions: ugo+rw
Apr 29 08:42:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:25 devstack sudo[91665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb
Apr 29 08:42:25 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:26 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb" returned: 0 in 0.630s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:26 devstack sudo[91668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.info
Apr 29 08:42:26 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac9c1736-ccdc-4873-981a-51046a959e39 tempest-VolumesActionsTest-1932641639 None] Acquiring lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" by "attach_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac9c1736-ccdc-4873-981a-51046a959e39 tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" acquired by "attach_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:26 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ac9c1736-ccdc-4873-981a-51046a959e39 tempest-VolumesActionsTest-1932641639 None] Attaching volume 56ddee98-e328-48d7-b8b9-ccfae0ef0d2a to instance d35c9431-936e-4571-a751-e8d6843a18b6 at mountpoint /dev/vdb on host None.
Apr 29 08:42:26 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.info" returned: 0 in 0.687s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:26 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.info is being set with open permissions: ugo+rw
Apr 29 08:42:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:26 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ac9c1736-ccdc-4873-981a-51046a959e39 tempest-VolumesActionsTest-1932641639 None] Attach volume completed successfully.
Apr 29 08:42:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac9c1736-ccdc-4873-981a-51046a959e39 tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" released by "attach_volume" :: held 0.131s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:26 devstack sudo[91671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.info
Apr 29 08:42:26 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f5cbe127-d24f-4074-a644-eb64e2869070 tempest-VolumesActionsTest-1932641639 None] Acquiring lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a-detach_volume" by "detach_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f5cbe127-d24f-4074-a644-eb64e2869070 tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:27 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-f5cbe127-d24f-4074-a644-eb64e2869070 tempest-VolumesActionsTest-1932641639 None] Detaching volume 56ddee98-e328-48d7-b8b9-ccfae0ef0d2a from instance d35c9431-936e-4571-a751-e8d6843a18b6.
Apr 29 08:42:27 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-f5cbe127-d24f-4074-a644-eb64e2869070 tempest-VolumesActionsTest-1932641639 None] Detach volume completed successfully.
Apr 29 08:42:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-f5cbe127-d24f-4074-a644-eb64e2869070 tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:27 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.info" returned: 0 in 0.679s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.711s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:27 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-9c0f13ad-79bc-45f4-a1f1-cd3905f68ccd tempest-VolumeDependencyTests-1355392568 None] Create snapshot completed successfully
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=114,cinder:UPDATE=157,cinder:DELETE=11,cinder:INSERT=36 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Flow 'volume_create_manager' (f4d0914c-a96d-4d5d-9449-e532585c4c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c5cb87-95df-4e5a-bdec-fbbc243e7948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c5cb87-95df-4e5a-bdec-fbbc243e7948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-503577710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43093c8c-025b-4eeb-be78-acf34930e801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ae0164134b4a059b71992a607b1ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5bd03436-b36d-49f2-86a0-5254f448e2cb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:28Z,use_quota=True,user_id='0e8d78e9ee094b23a381896f81e6650b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341fcdb9-7b72-464d-ae9b-55510c490973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341fcdb9-7b72-464d-ae9b-55510c490973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454c43c0-1eb0-4b9c-af67-4ae12020b767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454c43c0-1eb0-4b9c-af67-4ae12020b767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '43093c8c-025b-4eeb-be78-acf34930e801', 'volume_name': 'volume-43093c8c-025b-4eeb-be78-acf34930e801', 'volume_size': 1, 'snapshot_id': '5bd03436-b36d-49f2-86a0-5254f448e2cb'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5235021-112c-4a8a-b291-0e5d333a35a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5235021-112c-4a8a-b291-0e5d333a35a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b50bf67-909d-4b7d-897d-19738d69a0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:28 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Volume 43093c8c-025b-4eeb-be78-acf34930e801: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-43093c8c-025b-4eeb-be78-acf34930e801', 'volume_size': 1, 'snapshot_id': '5bd03436-b36d-49f2-86a0-5254f448e2cb'}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-5bd03436-b36d-49f2-86a0-5254f448e2cb-43093c8c-025b-4eeb-be78-acf34930e801" by "_create_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-5bd03436-b36d-49f2-86a0-5254f448e2cb-43093c8c-025b-4eeb-be78-acf34930e801" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Creating volume 43093c8c-025b-4eeb-be78-acf34930e801 from snapshot 5bd03436-b36d-49f2-86a0-5254f448e2cb {{(pid=83885) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-43093c8c-025b-4eeb-be78-acf34930e801" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-43093c8c-025b-4eeb-be78-acf34930e801" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] snapshot: 5bd03436-b36d-49f2-86a0-5254f448e2cb, volume: 43093c8c-025b-4eeb-be78-acf34930e801,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5701dd-2ca6-4b5d-968e-d71e231b5fc1]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:28 devstack sudo[91674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb
Apr 29 08:42:28 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:29 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb" returned: 0 in 0.873s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:42:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:42:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:42:29 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8dfb23-6c10-4aa7-8127-4a21a63b987a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:29 devstack sudo[91720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a
Apr 29 08:42:29 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:30 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" returned: 0 in 0.790s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:30 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801 not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:42:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:30 devstack sudo[91726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801
Apr 29 08:42:30 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:35 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801" returned: 0 in 4.817s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:35 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e94d1fe-68c2-4c42-8d0e-fb9f09e9d739]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:35 devstack sudo[91747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a
Apr 29 08:42:35 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:36 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" returned: 0 in 0.884s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:42:36 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Converted 1024.00 MB image at 212.55 MB/s
Apr 29 08:42:36 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801 is being set with open permissions: ugo+rw
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:36 devstack sudo[91752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801
Apr 29 08:42:36 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:36 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801" returned: 0 in 0.598s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-43093c8c-025b-4eeb-be78-acf34930e801" released by "_copy_volume_from_snapshot" :: held 8.069s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-5bd03436-b36d-49f2-86a0-5254f448e2cb-43093c8c-025b-4eeb-be78-acf34930e801" released by "_create_volume_from_snapshot" :: held 8.098s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.112s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.030s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51ade16-55b0-46b4-b893-7981af74f532]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b50bf67-909d-4b7d-897d-19738d69a0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43093c8c-025b-4eeb-be78-acf34930e801', 'volume_size': 1, 'snapshot_id': '5bd03436-b36d-49f2-86a0-5254f448e2cb'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369db85f-e3b5-47ec-a2dc-883d7e7f1d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:36 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Volume volume-43093c8c-025b-4eeb-be78-acf34930e801 (43093c8c-025b-4eeb-be78-acf34930e801): created successfully
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369db85f-e3b5-47ec-a2dc-883d7e7f1d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Flow 'volume_create_manager' (f4d0914c-a96d-4d5d-9449-e532585c4c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:36 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ab2e310a-6631-4d57-9899-941ea0be558e tempest-VolumeDependencyTests-1355392568 None] Created volume successfully.
Apr 29 08:42:36 devstack sudo[91755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a
Apr 29 08:42:36 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:37 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" returned: 0 in 0.742s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-5bd03436-b36d-49f2-86a0-5254f448e2cb-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3357f2-e832-4d32-8264-f87cd3b37e32]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-5bd03436-b36d-49f2-86a0-5254f448e2cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-5bd03436-b36d-49f2-86a0-5254f448e2cb" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-5bd03436-b36d-49f2-86a0-5254f448e2cb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Deleting offline snapshot 5bd03436-b36d-49f2-86a0-5254f448e2cb of volume 5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] snapshot_file for this snap is: volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f39fdc-775e-4b53-88b8-74f70a2c7d3b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:37 devstack sudo[91760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a
Apr 29 08:42:37 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:37 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb
Apr 29 08:42:37 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:38 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" returned: 0 in 0.772s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.5a70a467-c819-4438-bc02-051c2ca05233t37slrjp.img {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:38 devstack sudo[91771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.5a70a467-c819-4438-bc02-051c2ca05233t37slrjp.img
Apr 29 08:42:38 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:38 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb" returned: 0 in 0.767s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:42:38 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52833fc-1c2f-42bf-adc8-d99a111ec17f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:38 devstack sudo[91773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a
Apr 29 08:42:38 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:39 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" returned: 0 in 1.024s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:39 devstack sudo[91789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb
Apr 29 08:42:39 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:40 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb" returned: 0 in 1.465s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:40 devstack sudo[91795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb
Apr 29 08:42:40 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:42 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.5a70a467-c819-4438-bc02-051c2ca05233t37slrjp.img" returned: 0 in 4.357s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:42 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[07579edd-a18e-46db-bca3-d27ce106d8c5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:42 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a.5bd03436-b36d-49f2-86a0-5254f448e2cb" returned: 0 in 1.814s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-5bd03436-b36d-49f2-86a0-5254f448e2cb" released by "_delete_snapshot" :: held 5.182s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" released by "delete_snapshot" :: held 5.206s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:42 devstack sudo[91798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a
Apr 29 08:42:42 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:42 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Created reservations ['e9f381e3-cf2f-4180-991e-a5c3b4a9745a', 'fbb03011-e9f6-4b7e-980d-02c59681d52a', '72a3ae5f-159a-4e57-aa48-d3858b972dae', '148a0727-6098-434d-a0fe-7a47d407b64a'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Delete snapshot completed successfully.
Apr 29 08:42:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08fa3293-0e99-4cd2-bcba-0696f6652c1a tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-5bd03436-b36d-49f2-86a0-5254f448e2cb-delete_snapshot" released by "delete_snapshot" :: held 5.349s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:43 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" returned: 0 in 0.843s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:43 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.5a70a467-c819-4438-bc02-051c2ca05233t37slrjp.img {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:42:43 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Converted 1024.00 MB image at 234.90 MB/s
Apr 29 08:42:43 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] 5a70a467-c819-4438-bc02-051c2ca05233 was raw, no need to convert to raw {{(pid=83885) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 29 08:42:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-5d4e6d35-fef7-4005-92a0-10fa779c5a3a-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-5d4e6d35-fef7-4005-92a0-10fa779c5a3a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:44 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c9f116-54c5-4358-99d6-82a25e3a1079]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:44 devstack sudo[91804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a
Apr 29 08:42:44 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:44 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" returned: 0 in 0.814s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:44 devstack sudo[91809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a
Apr 29 08:42:44 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:45 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" returned: 0 in 0.675s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-5d4e6d35-fef7-4005-92a0-10fa779c5a3a" released by "delete_volume" :: held 1.569s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:45 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Created reservations ['968596eb-ef40-4e33-8bd2-ac6321a9125b', 'b604ea7e-7800-445f-8174-f58965890790', '2c138da8-af6c-4b64-9dc5-3f0a61ba710f', 'bb24e017-2eae-4be2-9c41-48620e5f1738'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:45 devstack sudo[91812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:42:45 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:46 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.635s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:46 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Deleted volume successfully.
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58a1afac-ecc3-4149-9d20-14c8500a34d6 tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-5d4e6d35-fef7-4005-92a0-10fa779c5a3a-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Flow 'volume_create_manager' (b112006c-b96e-4efb-bfe8-92ce4944b1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23642e8b-1665-432b-be80-dd860a6f1954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23642e8b-1665-432b-be80-dd860a6f1954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2025498751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9989c844-bf46-41ee-ac39-1225889b4048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ae0164134b4a059b71992a607b1ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:47Z,use_quota=True,user_id='0e8d78e9ee094b23a381896f81e6650b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa3db8c-6126-4c94-a36b-ad895988bbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa3db8c-6126-4c94-a36b-ad895988bbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a6b7f1-279c-4b07-bfcb-04ddfed6014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a6b7f1-279c-4b07-bfcb-04ddfed6014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9989c844-bf46-41ee-ac39-1225889b4048', 'volume_name': 'volume-9989c844-bf46-41ee-ac39-1225889b4048', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18de8bd3-619a-4b86-b614-808d78cd364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18de8bd3-619a-4b86-b614-808d78cd364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ef26d0-d915-49d3-a8c9-a7067660b3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:46 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Volume 9989c844-bf46-41ee-ac39-1225889b4048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9989c844-bf46-41ee-ac39-1225889b4048', 'volume_size': 1}
Apr 29 08:42:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:42:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:49 devstack sudo[91815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:42:49 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:50 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.638s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:56 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=2,cinder:SELECT=23 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:42:56 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=15,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.610s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Uploaded volume to glance image-id: 5a70a467-c819-4438-bc02-051c2ca05233. {{(pid=83885) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.618s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2025498751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9989c844-bf46-41ee-ac39-1225889b4048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ae0164134b4a059b71992a607b1ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:47Z,use_quota=True,user_id='0e8d78e9ee094b23a381896f81e6650b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Creating volume 9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:02 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:43:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:02 devstack sudo[91819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 1073741824
Apr 29 08:43:02 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-8bce04c7-05fe-49c9-98d4-3d1e2b38e662 tempest-VolumesActionsTest-1932641639 None] Copy volume to image completed successfully.
Apr 29 08:43:03 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 1073741824" returned: 0 in 0.928s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:03 devstack sudo[91824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048
Apr 29 08:43:03 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:03 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048" returned: 0 in 0.589s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.381s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ef26d0-d915-49d3-a8c9-a7067660b3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9989c844-bf46-41ee-ac39-1225889b4048', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f35ec0-6e08-4716-a849-94cbb7648431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e02a27e-307f-49fd-8fe6-d1145ba8474e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:03 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Volume volume-9989c844-bf46-41ee-ac39-1225889b4048 (9989c844-bf46-41ee-ac39-1225889b4048): created successfully
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f35ec0-6e08-4716-a849-94cbb7648431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Flow 'volume_create_manager' (b112006c-b96e-4efb-bfe8-92ce4944b1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:03 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5b725aee-fe2c-4f24-a549-490b9701419b tempest-VolumeDependencyTests-1355392568 None] Created volume successfully.
Apr 29 08:43:04 devstack sudo[91828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a
Apr 29 08:43:04 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:04 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" returned: 0 in 0.710s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:04 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca403ae-f638-489f-81a2-96cba030caf4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:04 devstack sudo[91833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a
Apr 29 08:43:04 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Flow 'volume_create_manager' (c3ae33c4-45bf-4dfe-baf1-d1eb99954a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5c12f5-a169-4325-8702-7431627edd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5c12f5-a169-4325-8702-7431627edd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2117028644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fbe6e0-10e9-423f-92c8-09b58e36201d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ae0164134b4a059b71992a607b1ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=9989c844-bf46-41ee-ac39-1225889b4048,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:05Z,use_quota=True,user_id='0e8d78e9ee094b23a381896f81e6650b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111d61c9-89c5-4ca2-855a-daa21047d0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111d61c9-89c5-4ca2-855a-daa21047d0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e25142-2964-4a29-b06b-e6b739277e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e25142-2964-4a29-b06b-e6b739277e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '13fbe6e0-10e9-423f-92c8-09b58e36201d', 'volume_name': 'volume-13fbe6e0-10e9-423f-92c8-09b58e36201d', 'volume_size': 1, 'source_volid': '9989c844-bf46-41ee-ac39-1225889b4048', 'source_volstatus': 'available'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc6e79c-913f-490e-b16b-bf741d8bc1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc6e79c-913f-490e-b16b-bf741d8bc1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e564a6d-368f-4867-b595-dd69e97d5293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:05 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Volume 13fbe6e0-10e9-423f-92c8-09b58e36201d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-13fbe6e0-10e9-423f-92c8-09b58e36201d', 'volume_size': 1, 'source_volid': '9989c844-bf46-41ee-ac39-1225889b4048', 'source_volstatus': 'available'}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:05 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" returned: 0 in 0.737s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:05 devstack sudo[91838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img
Apr 29 08:43:05 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:09 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img" returned: 0 in 4.353s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:09 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aaac4c-6594-4a6f-ba24-e190ab782379]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:09 devstack sudo[91852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a
Apr 29 08:43:09 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:10 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" returned: 0 in 0.958s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:10 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a, size 1024.00 MB, duration 4.35 sec, destination /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:43:10 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Converted 1024.00 MB image at 235.16 MB/s
Apr 29 08:43:10 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] 807e6e62-27f9-43b7-873e-f334504f2178 was raw, converting to qcow2 {{(pid=83885) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 29 08:43:10 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94b3c1d-0cd3-4ddd-8c5e-12dc48e7c61e]: (4, 'raw') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:10 devstack sudo[91859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img
Apr 29 08:43:10 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:11 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img" returned: 0 in 0.717s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:11 devstack sudo[91863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img
Apr 29 08:43:11 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:12 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img" returned: 1 in 0.647s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img' failed. Not Retrying. {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:43:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img /opt/stack/data/cinder/conversion/vol_upload_pt579rj7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:12 devstack sudo[91868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img /opt/stack/data/cinder/conversion/vol_upload_pt579rj7
Apr 29 08:43:12 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:12 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img /opt/stack/data/cinder/conversion/vol_upload_pt579rj7" returned: 0 in 0.618s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:12 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Image conversion details: src /opt/stack/data/cinder/conversion/56ddee98-e328-48d7-b8b9-ccfae0ef0d2a.temp_image.807e6e62-27f9-43b7-873e-f334504f2178ihrah9sf.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pt579rj7 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:43:12 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 29 08:43:12 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dec7d8-aff1-45b0-ab7f-c22afa263f5b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pt579rj7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:12 devstack sudo[91873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pt579rj7
Apr 29 08:43:12 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:13 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pt579rj7" returned: 0 in 0.669s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.745s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Uploaded volume to glance image-id: 807e6e62-27f9-43b7-873e-f334504f2178. {{(pid=83885) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 29 08:43:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.325s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:14 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Cloning volume 9989c844-bf46-41ee-ac39-1225889b4048 to volume 13fbe6e0-10e9-423f-92c8-09b58e36201d
Apr 29 08:43:14 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-18e2c0b6-84c6-4590-b97f-f44a4353ba67 tempest-VolumesActionsTest-1932641639 None] Copy volume to image completed successfully.
Apr 29 08:43:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Creating offline snapshot bc488021-b903-445a-92d9-40e1b0f1e62e of volume 9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:43:14 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd78bd0-b4c5-4b64-9169-55b7809b9329]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:14 devstack sudo[91879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048
Apr 29 08:43:14 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:15 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048" returned: 0 in 0.778s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:15 devstack sudo[91884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e 1G
Apr 29 08:43:15 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Acquiring lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Acquiring lock "cinder-quobyte-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Lock "cinder-quobyte-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:15 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ede379-a2fc-4603-af28-1223253ad359]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:15 devstack sudo[91886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a
Apr 29 08:43:15 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:16 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e 1G" returned: 0 in 0.841s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9989c844-bf46-41ee-ac39-1225889b4048 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:16 devstack sudo[91891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9989c844-bf46-41ee-ac39-1225889b4048 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e
Apr 29 08:43:16 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:16 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" returned: 0 in 0.826s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:16 devstack sudo[91896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a
Apr 29 08:43:16 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:17 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9989c844-bf46-41ee-ac39-1225889b4048 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e" returned: 0 in 0.692s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:17 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e is being set with open permissions: ugo+rw
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:17 devstack sudo[91901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e
Apr 29 08:43:17 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:17 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" returned: 0 in 0.625s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Lock "cinder-quobyte-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a" released by "delete_volume" :: held 1.494s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Created reservations ['fff2cd49-e3ca-41ec-a11f-8e7bbc3c42db', '82c3e361-3af7-46c6-b440-57982f4a161f', '3f760d3a-26a4-412e-8cc7-192480ddebbd', '74dbe49a-c780-4ec2-ac73-014a8fe3b965'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:17 devstack sudo[91904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:43:17 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:17 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e" returned: 0 in 0.645s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:17 devstack sudo[91907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.info
Apr 29 08:43:17 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:17 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.606s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:17 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Deleted volume successfully.
Apr 29 08:43:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c32d50b0-3fd5-43e1-9ed7-dc222a2ecebe tempest-VolumesActionsTest-1932641639 None] Lock "cinder-56ddee98-e328-48d7-b8b9-ccfae0ef0d2a-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:18 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.info" returned: 0 in 0.638s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:18 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.info is being set with open permissions: ugo+rw
Apr 29 08:43:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:18 devstack sudo[91911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.info
Apr 29 08:43:18 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:19 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.info" returned: 0 in 0.665s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-13fbe6e0-10e9-423f-92c8-09b58e36201d" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-13fbe6e0-10e9-423f-92c8-09b58e36201d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] snapshot: bc488021-b903-445a-92d9-40e1b0f1e62e, volume: 13fbe6e0-10e9-423f-92c8-09b58e36201d,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9147cd0-24fa-4c30-b75d-034e6e137590]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:19 devstack sudo[91915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e
Apr 29 08:43:19 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:19 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e" returned: 0 in 0.740s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9989c844-bf46-41ee-ac39-1225889b4048(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43ac7c1-86bd-4da0-b714-3b8985aab289]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:19 devstack sudo[91921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048
Apr 29 08:43:19 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:20 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048" returned: 0 in 0.779s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:20 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:43:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:20 devstack sudo[91927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d
Apr 29 08:43:20 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:26 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d" returned: 0 in 5.701s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a154a7-ade0-437f-aef8-a5d4d3a8ea1a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:26 devstack sudo[91981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048
Apr 29 08:43:26 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Flow 'volume_create_manager' (e28cd066-0049-4aaa-bdc3-ab31c7948505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2522c8e-8116-43f2-ac18-aaf82dace16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2522c8e-8116-43f2-ac18-aaf82dace16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-865215033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c0b486-0825-4e48-8b3c-68e0b0653ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e695e1e49b4346949495271d5ea9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:27Z,use_quota=True,user_id='0a00d5c079e345dfb055b01d8dd4ce3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acf166d-069b-498f-93d4-49f8593df0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acf166d-069b-498f-93d4-49f8593df0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5bd30d-ad9a-4cf2-b58f-2432b83d2bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5bd30d-ad9a-4cf2-b58f-2432b83d2bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c0b486-0825-4e48-8b3c-68e0b0653ee5', 'volume_name': 'volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07b720b-742e-437d-98f3-98e39297067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07b720b-742e-437d-98f3-98e39297067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141de410-e1aa-49ae-b07a-2ebb0663d572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Volume d1c0b486-0825-4e48-8b3c-68e0b0653ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5', 'volume_size': 1}
Apr 29 08:43:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:27 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048" returned: 0 in 0.874s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:43:27 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Converted 1024.00 MB image at 179.57 MB/s
Apr 29 08:43:27 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d is being set with open permissions: ugo+rw
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:27 devstack sudo[91986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d
Apr 29 08:43:27 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:27 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d" returned: 0 in 0.668s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-13fbe6e0-10e9-423f-92c8-09b58e36201d" released by "_copy_volume_from_snapshot" :: held 8.851s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-bc488021-b903-445a-92d9-40e1b0f1e62e" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-bc488021-b903-445a-92d9-40e1b0f1e62e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Deleting offline snapshot bc488021-b903-445a-92d9-40e1b0f1e62e of volume 9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] snapshot_file for this snap is: volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c23c81-c51e-46b6-a0a2-6d10004418ca]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:28 devstack sudo[91989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e
Apr 29 08:43:28 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:28 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e" returned: 0 in 0.747s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:28 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9989c844-bf46-41ee-ac39-1225889b4048(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:43:28 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f08072d-d0ef-4d9d-b9a0-586c059d8c05]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:28 devstack sudo[91994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048
Apr 29 08:43:28 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:29 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048" returned: 0 in 0.672s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:29 devstack sudo[91999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e
Apr 29 08:43:29 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:30 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e" returned: 0 in 0.667s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:30 devstack sudo[92004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e
Apr 29 08:43:30 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:30 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048.bc488021-b903-445a-92d9-40e1b0f1e62e" returned: 0 in 0.564s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-bc488021-b903-445a-92d9-40e1b0f1e62e" released by "_delete_snapshot" :: held 2.750s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.043s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.963s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-865215033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c0b486-0825-4e48-8b3c-68e0b0653ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e695e1e49b4346949495271d5ea9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:27Z,use_quota=True,user_id='0a00d5c079e345dfb055b01d8dd4ce3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Creating volume d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:30 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e564a6d-368f-4867-b595-dd69e97d5293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fbe6e0-10e9-423f-92c8-09b58e36201d', 'volume_size': 1, 'source_volid': '9989c844-bf46-41ee-ac39-1225889b4048', 'source_volstatus': 'available'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:30 devstack sudo[92007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 1073741824
Apr 29 08:43:30 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62919c51-9219-47a3-aba7-76554741570b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:30 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Volume volume-13fbe6e0-10e9-423f-92c8-09b58e36201d (13fbe6e0-10e9-423f-92c8-09b58e36201d): created successfully
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62919c51-9219-47a3-aba7-76554741570b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Flow 'volume_create_manager' (c3ae33c4-45bf-4dfe-baf1-d1eb99954a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:30 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-df72c4c1-daea-4f8c-817e-b526b4b8cdbe tempest-VolumeDependencyTests-1355392568 None] Created volume successfully.
Apr 29 08:43:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-9989c844-bf46-41ee-ac39-1225889b4048-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-9989c844-bf46-41ee-ac39-1225889b4048-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-9989c844-bf46-41ee-ac39-1225889b4048" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-9989c844-bf46-41ee-ac39-1225889b4048" acquired by "delete_volume" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:31 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb74ccf-194e-447d-a460-7a6d22ec243c]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:31 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 1073741824" returned: 0 in 0.818s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:31 devstack sudo[92014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5
Apr 29 08:43:31 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:31 devstack sudo[92013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048
Apr 29 08:43:31 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:32 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" returned: 0 in 0.596s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141de410-e1aa-49ae-b07a-2ebb0663d572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551d06e2-70ce-41a6-9161-6fc7f796713c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:32 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Volume volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 (d1c0b486-0825-4e48-8b3c-68e0b0653ee5): created successfully
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551d06e2-70ce-41a6-9161-6fc7f796713c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Flow 'volume_create_manager' (e28cd066-0049-4aaa-bdc3-ab31c7948505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:32 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-00b83912-0d83-4451-b9c2-9ff4fba0d3e2 tempest-VolumesCloneTest-641429339 None] Created volume successfully.
Apr 29 08:43:32 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048" returned: 0 in 0.815s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:32 devstack sudo[92027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048
Apr 29 08:43:32 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:32 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9989c844-bf46-41ee-ac39-1225889b4048" returned: 0 in 0.579s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-9989c844-bf46-41ee-ac39-1225889b4048" released by "delete_volume" :: held 1.456s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:32 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Created reservations ['46f53586-3428-4b36-9eb3-639597b1730c', 'd0020df2-9f36-4d3c-82d8-1a590675f8c6', '873c5dfa-22ef-46d9-8df5-7f9b89aae243', '241dd79f-811f-4059-984d-8f113a455507'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:33 devstack sudo[92030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:43:33 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Flow 'volume_create_manager' (0d14457c-f3e3-433f-b779-5d0e4085f8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a991dc-dcb0-4aab-bd5a-5aae8cc3d978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a991dc-dcb0-4aab-bd5a-5aae8cc3d978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-918526594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ccd54c-57c9-42a7-b4a1-116d6092c7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e695e1e49b4346949495271d5ea9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=d1c0b486-0825-4e48-8b3c-68e0b0653ee5,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:33Z,use_quota=True,user_id='0a00d5c079e345dfb055b01d8dd4ce3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8200cc-27d9-4d3b-adce-e2bc50a11935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8200cc-27d9-4d3b-adce-e2bc50a11935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c168c7-58f1-46df-ae9a-1b1cc69983fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c168c7-58f1-46df-ae9a-1b1cc69983fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '70ccd54c-57c9-42a7-b4a1-116d6092c7a3', 'volume_name': 'volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3', 'volume_size': 2, 'source_volid': 'd1c0b486-0825-4e48-8b3c-68e0b0653ee5', 'source_volstatus': 'available'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f659c4-8468-4bd5-8fc4-b2139be289ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f659c4-8468-4bd5-8fc4-b2139be289ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936882be-ba4e-4dce-9edf-fc913a8d56ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Volume 70ccd54c-57c9-42a7-b4a1-116d6092c7a3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3', 'volume_size': 2, 'source_volid': 'd1c0b486-0825-4e48-8b3c-68e0b0653ee5', 'source_volstatus': 'available'}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:33 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Cloning volume d1c0b486-0825-4e48-8b3c-68e0b0653ee5 to volume 70ccd54c-57c9-42a7-b4a1-116d6092c7a3
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-13fbe6e0-10e9-423f-92c8-09b58e36201d-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Creating offline snapshot 998ab820-f489-4e1c-aa33-55d9d72e6f95 of volume d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-13fbe6e0-10e9-423f-92c8-09b58e36201d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[657cdcf3-f1a1-4c1e-bca8-6459214af289]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-13fbe6e0-10e9-423f-92c8-09b58e36201d" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:33 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-13fbe6e0-10e9-423f-92c8-09b58e36201d" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.716s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:33 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Deleted volume successfully.
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5a40a-0b98-41ea-afa8-c015533e1fdd]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c11efefa-a5cc-445d-a83e-144dc561e149 tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-9989c844-bf46-41ee-ac39-1225889b4048-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:33 devstack sudo[92034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5
Apr 29 08:43:33 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:33 devstack sudo[92035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d
Apr 29 08:43:33 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:34 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" returned: 0 in 0.768s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:34 devstack sudo[92045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 1G
Apr 29 08:43:34 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:34 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d" returned: 0 in 0.741s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:34 devstack sudo[92047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d
Apr 29 08:43:34 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:35 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-13fbe6e0-10e9-423f-92c8-09b58e36201d" returned: 0 in 0.609s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-13fbe6e0-10e9-423f-92c8-09b58e36201d" released by "delete_volume" :: held 1.404s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Created reservations ['bc6a826e-c23c-453e-9fb6-6344f1018afa', 'bd4ce49e-2716-4bb2-a8b7-11ed00eceb54', '557465a2-dc0e-460c-b031-3ccb7ae0d788', '8ad56a5f-0a8f-4781-95e9-b5d737b8705c'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:35 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 1G" returned: 0 in 0.810s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:35 devstack sudo[92054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95
Apr 29 08:43:35 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:35 devstack sudo[92056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:43:35 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:35 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95" returned: 0 in 0.676s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:35 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 is being set with open permissions: ugo+rw
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-43093c8c-025b-4eeb-be78-acf34930e801-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:35 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.667s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:35 devstack sudo[92063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:35 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:35 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Deleted volume successfully.
Apr 29 08:43:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-43093c8c-025b-4eeb-be78-acf34930e801-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c9503c48-a8b4-46f8-9e7a-f50302d9ff0e tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-13fbe6e0-10e9-423f-92c8-09b58e36201d-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "cinder-quobyte-43093c8c-025b-4eeb-be78-acf34930e801" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-43093c8c-025b-4eeb-be78-acf34930e801" acquired by "delete_volume" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:36 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ec310c-eefd-4de8-95ed-d718181b42f6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:36 devstack sudo[92065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801
Apr 29 08:43:36 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:36 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95" returned: 0 in 0.668s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:36 devstack sudo[92068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.info
Apr 29 08:43:36 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:36 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801" returned: 0 in 0.705s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:36 devstack sudo[92073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801
Apr 29 08:43:36 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:37 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.info" returned: 0 in 0.598s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:37 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.info is being set with open permissions: ugo+rw
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:37 devstack sudo[92076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.info
Apr 29 08:43:37 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:37 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-43093c8c-025b-4eeb-be78-acf34930e801" returned: 0 in 0.626s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-quobyte-43093c8c-025b-4eeb-be78-acf34930e801" released by "delete_volume" :: held 1.376s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Created reservations ['a3021b21-5a7d-4890-9649-bb38a4ebb9c0', '167f67eb-3c29-47b7-82af-232fafb5744b', '8bb87513-765c-4a76-88f9-cefc6f724586', 'f7c8de91-4726-4bdf-a40a-835a31175c30'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:37 devstack sudo[92079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:43:37 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:37 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.info" returned: 0 in 0.623s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Acquiring lock "cinder-quobyte-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Lock "cinder-quobyte-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] snapshot: 998ab820-f489-4e1c-aa33-55d9d72e6f95, volume: 70ccd54c-57c9-42a7-b4a1-116d6092c7a3,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c7cc08-b836-4acf-9bb6-867de3b42dfa]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:38 devstack sudo[92082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95
Apr 29 08:43:38 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:38 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.666s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:38 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:38 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Deleted volume successfully.
Apr 29 08:43:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0bcdc12b-af68-45be-ac5d-81905690eb2b tempest-VolumeDependencyTests-1355392568 None] Lock "cinder-43093c8c-025b-4eeb-be78-acf34930e801-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:38 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95" returned: 0 in 0.817s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:43:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:43:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:43:38 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b524d00-41ec-42ec-8ca8-b1387018ceb2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:38 devstack sudo[92090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5
Apr 29 08:43:38 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:39 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" returned: 0 in 0.800s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:39 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3 not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:43:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:39 devstack sudo[92096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3
Apr 29 08:43:39 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:44 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" returned: 0 in 4.433s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:44 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11f26bb-b511-4521-85cf-a7128cf0fffd]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:44 devstack sudo[92110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5
Apr 29 08:43:44 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:44 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" returned: 0 in 0.957s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:44 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:43:44 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Converted 1024.00 MB image at 230.94 MB/s
Apr 29 08:43:44 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3 is being set with open permissions: ugo+rw
Apr 29 08:43:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:45 devstack sudo[92115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3
Apr 29 08:43:45 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:45 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" returned: 0 in 0.611s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Lock "cinder-quobyte-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" released by "_copy_volume_from_snapshot" :: held 7.706s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Acquiring lock "cinder-quobyte-998ab820-f489-4e1c-aa33-55d9d72e6f95" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Lock "cinder-quobyte-998ab820-f489-4e1c-aa33-55d9d72e6f95" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Deleting offline snapshot 998ab820-f489-4e1c-aa33-55d9d72e6f95 of volume d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:43:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] snapshot_file for this snap is: volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:43:45 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[619ca54a-aecb-4444-b98c-2c7289e7989a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:45 devstack sudo[92118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95
Apr 29 08:43:45 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:46 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95" returned: 0 in 0.744s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:43:46 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba73b2f7-8196-480e-8017-e95c858c67aa]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:46 devstack sudo[92123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5
Apr 29 08:43:46 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:47 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" returned: 0 in 0.699s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:47 devstack sudo[92128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95
Apr 29 08:43:47 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:47 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95" returned: 0 in 0.697s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:47 devstack sudo[92133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95
Apr 29 08:43:47 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=40,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=5 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:43:48 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5.998ab820-f489-4e1c-aa33-55d9d72e6f95" returned: 0 in 0.577s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Lock "cinder-quobyte-998ab820-f489-4e1c-aa33-55d9d72e6f95" released by "_delete_snapshot" :: held 2.805s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.852s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936882be-ba4e-4dce-9edf-fc913a8d56ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3', 'volume_size': 2, 'source_volid': 'd1c0b486-0825-4e48-8b3c-68e0b0653ee5', 'source_volstatus': 'available'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1616b266-27ed-47ca-9598-ad1c515cb486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:48 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Volume volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3 (70ccd54c-57c9-42a7-b4a1-116d6092c7a3): created successfully
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1616b266-27ed-47ca-9598-ad1c515cb486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Flow 'volume_create_manager' (0d14457c-f3e3-433f-b779-5d0e4085f8af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:48 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2ada68c7-528a-4a7f-8866-36a400a09800 tempest-VolumesCloneTest-641429339 None] Created volume successfully.
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Acquiring lock "cinder-70ccd54c-57c9-42a7-b4a1-116d6092c7a3-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Lock "cinder-70ccd54c-57c9-42a7-b4a1-116d6092c7a3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Acquiring lock "cinder-quobyte-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Lock "cinder-quobyte-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" acquired by "delete_volume" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db8979-c387-46a1-89e6-2dc3aa1c2632]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:48 devstack sudo[92136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3
Apr 29 08:43:48 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:49 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" returned: 0 in 0.683s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:49 devstack sudo[92141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3
Apr 29 08:43:49 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:43:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:49 devstack sudo[92143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:43:49 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:50 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" returned: 0 in 0.613s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Lock "cinder-quobyte-70ccd54c-57c9-42a7-b4a1-116d6092c7a3" released by "delete_volume" :: held 1.334s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Created reservations ['4efb6ef5-bc4c-4424-82a8-b3a2d33e7aae', '47b056ff-67cc-4960-856a-6ea86e8bd314', 'd4ccb46d-4da4-4d73-8036-630febc6f16f', '49891887-492c-4a78-8fc9-f369384da052'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:50 devstack sudo[92146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:43:50 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:50 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.622s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:50 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.585s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:50 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Deleted volume successfully.
Apr 29 08:43:50 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-2efe7cb2-64f2-40de-bdf4-005be0924b1b tempest-VolumesCloneTest-641429339 None] Lock "cinder-70ccd54c-57c9-42a7-b4a1-116d6092c7a3-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Acquiring lock "cinder-d1c0b486-0825-4e48-8b3c-68e0b0653ee5-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Lock "cinder-d1c0b486-0825-4e48-8b3c-68e0b0653ee5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Acquiring lock "cinder-quobyte-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Lock "cinder-quobyte-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" acquired by "delete_volume" :: waited 0.013s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:51 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76f6e21-6dd8-454d-b8d7-95c0aef4d2eb]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:51 devstack sudo[92150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5
Apr 29 08:43:51 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:51 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" returned: 0 in 0.710s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:51 devstack sudo[92155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5
Apr 29 08:43:51 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:52 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" returned: 0 in 0.566s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Lock "cinder-quobyte-d1c0b486-0825-4e48-8b3c-68e0b0653ee5" released by "delete_volume" :: held 1.327s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:52 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Created reservations ['765c2a62-3bf2-4eba-af95-85bfa3d3cfae', '64fba316-75d9-4bbd-ae55-88c4e4a83896', '5d90a38f-0866-41e1-b6e3-1d12d9dd14ad', 'e43fdc88-2ec1-4655-b958-ac7ea6f3d5b9'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:52 devstack sudo[92158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:43:52 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:53 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.565s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:53 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:53 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Deleted volume successfully.
Apr 29 08:43:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-610135d0-bd75-43b9-b954-e7e44397bdba tempest-VolumesCloneTest-641429339 None] Lock "cinder-d1c0b486-0825-4e48-8b3c-68e0b0653ee5-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:02 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=23,cinder:SELECT=11,cinder:DELETE=1,cinder:INSERT=5 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:44:03 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=66,cinder:INSERT=16,cinder:DELETE=4,cinder:SELECT=40 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (2f175abf-f995-4308-87cd-face08d2407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71211f0-2455-440e-83b2-18a5e6dd4ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71211f0-2455-440e-83b2-18a5e6dd4ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1564081052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d801eab3-60c7-489d-b3cb-3c7ac575bd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010c154bb93f4f0caa55b172d8e4c9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:05Z,use_quota=True,user_id='2a42c0db6afa4c28a7422b2c9a9264b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8db01b-df91-4d9b-a555-9455c3acf668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8db01b-df91-4d9b-a555-9455c3acf668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddaf9f1-ff42-4b80-807b-ae4da5a9d035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddaf9f1-ff42-4b80-807b-ae4da5a9d035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd801eab3-60c7-489d-b3cb-3c7ac575bd4b', 'volume_name': 'volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d3bc3f-e443-4ef6-a648-8c4078215831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d3bc3f-e443-4ef6-a648-8c4078215831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3ea135-33b7-42c8-a40f-690660c57964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:04 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Volume d801eab3-60c7-489d-b3cb-3c7ac575bd4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b', 'volume_size': 1}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1564081052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d801eab3-60c7-489d-b3cb-3c7ac575bd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010c154bb93f4f0caa55b172d8e4c9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:05Z,use_quota=True,user_id='2a42c0db6afa4c28a7422b2c9a9264b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Creating volume d801eab3-60c7-489d-b3cb-3c7ac575bd4b {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:04 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:44:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:04 devstack sudo[92163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b 1073741824
Apr 29 08:44:04 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:05 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b 1073741824" returned: 0 in 0.755s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:05 devstack sudo[92168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b
Apr 29 08:44:05 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:06 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" returned: 0 in 0.585s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3ea135-33b7-42c8-a40f-690660c57964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cdf258-d534-41ad-83ef-81f029a261f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:06 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Volume volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b (d801eab3-60c7-489d-b3cb-3c7ac575bd4b): created successfully
Apr 29 08:44:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cdf258-d534-41ad-83ef-81f029a261f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (2f175abf-f995-4308-87cd-face08d2407d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-cf70b621-4445-4b32-9243-347cd913e147 tempest-VolumesSnapshotTestJSON-1738300856 None] Created volume successfully.
Apr 29 08:44:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Creating offline snapshot fff8dcad-d79e-4fb8-8fff-fd538973ff04 of volume d801eab3-60c7-489d-b3cb-3c7ac575bd4b {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:44:07 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbff614a-bb69-4650-8452-338987f03a63]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:07 devstack sudo[92172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b
Apr 29 08:44:07 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:07 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" returned: 0 in 0.666s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:07 devstack sudo[92177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 1G
Apr 29 08:44:07 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:08 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 1G" returned: 0 in 0.784s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:08 devstack sudo[92183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04
Apr 29 08:44:08 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:09 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04" returned: 0 in 0.610s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:09 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 is being set with open permissions: ugo+rw
Apr 29 08:44:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:09 devstack sudo[92188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04
Apr 29 08:44:09 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:09 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04" returned: 0 in 0.572s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:09 devstack sudo[92191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.info
Apr 29 08:44:09 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:10 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.info" returned: 0 in 0.578s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:10 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.info is being set with open permissions: ugo+rw
Apr 29 08:44:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:10 devstack sudo[92194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.info
Apr 29 08:44:10 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:10 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.info" returned: 0 in 0.621s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.915s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:10 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-8c4c30f1-13b6-4636-be3f-377bd0b3defe tempest-VolumesSnapshotTestJSON-1738300856 None] Create snapshot completed successfully
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-fff8dcad-d79e-4fb8-8fff-fd538973ff04-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-fff8dcad-d79e-4fb8-8fff-fd538973ff04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-fff8dcad-d79e-4fb8-8fff-fd538973ff04" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-fff8dcad-d79e-4fb8-8fff-fd538973ff04" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Deleting offline snapshot fff8dcad-d79e-4fb8-8fff-fd538973ff04 of volume d801eab3-60c7-489d-b3cb-3c7ac575bd4b {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] snapshot_file for this snap is: volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd4dd4-568d-4a69-aa21-fb370a324585]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:11 devstack sudo[92198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04
Apr 29 08:44:11 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:12 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04" returned: 0 in 0.670s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:12 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[5299ee8d-98b9-417f-9ab9-ab6a7f9c5a2b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:12 devstack sudo[92203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b
Apr 29 08:44:12 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:12 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" returned: 0 in 0.667s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:12 devstack sudo[92208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04
Apr 29 08:44:12 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:13 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04" returned: 0 in 0.666s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:13 devstack sudo[92214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04
Apr 29 08:44:13 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:14 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b.fff8dcad-d79e-4fb8-8fff-fd538973ff04" returned: 0 in 0.571s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-fff8dcad-d79e-4fb8-8fff-fd538973ff04" released by "_delete_snapshot" :: held 2.672s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" released by "delete_snapshot" :: held 2.693s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Created reservations ['fb17bbc7-70ef-456c-8b41-8eddc8c8f994', '98688c33-b113-4c3d-aa19-9114a250e142', 'b533264d-f061-441f-ae8e-bd52bf3a15b8', 'df17aac4-22f1-4f99-99c5-3a3b77fa168c'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:14 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Delete snapshot completed successfully.
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-af5db8c3-730a-4053-a917-9cb2a9b5629f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-fff8dcad-d79e-4fb8-8fff-fd538973ff04-delete_snapshot" released by "delete_snapshot" :: held 2.858s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (9208616c-b7c7-48ea-a9ba-b0e4e7f603d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be410be-b021-483a-9035-f676527ea330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be410be-b021-483a-9035-f676527ea330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1304933955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fcf1ce-2c91-4f40-977e-2632e8e2763c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010c154bb93f4f0caa55b172d8e4c9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:15Z,use_quota=True,user_id='2a42c0db6afa4c28a7422b2c9a9264b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ac4fc2-78ff-4467-b7e7-ae49d28645f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ac4fc2-78ff-4467-b7e7-ae49d28645f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0f9494-0145-4fda-886e-4492604d24fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0f9494-0145-4fda-886e-4492604d24fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61fcf1ce-2c91-4f40-977e-2632e8e2763c', 'volume_name': 'volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2470ee83-98b0-46bf-8ec7-4e7056df3871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2470ee83-98b0-46bf-8ec7-4e7056df3871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd0c0df-ed7d-4b01-a681-372927351efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:14 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Volume 61fcf1ce-2c91-4f40-977e-2632e8e2763c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c', 'volume_size': 1}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1304933955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fcf1ce-2c91-4f40-977e-2632e8e2763c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010c154bb93f4f0caa55b172d8e4c9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:15Z,use_quota=True,user_id='2a42c0db6afa4c28a7422b2c9a9264b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Creating volume 61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:15 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:15 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:44:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:15 devstack sudo[92217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c 1073741824
Apr 29 08:44:15 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:15 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c 1073741824" returned: 0 in 0.786s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:15 devstack sudo[92222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c
Apr 29 08:44:15 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:16 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c" returned: 0 in 0.575s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd0c0df-ed7d-4b01-a681-372927351efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba43a1d-6096-4ac1-8b2b-25872c1e0367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:16 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Volume volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c (61fcf1ce-2c91-4f40-977e-2632e8e2763c): created successfully
Apr 29 08:44:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba43a1d-6096-4ac1-8b2b-25872c1e0367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:16 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (9208616c-b7c7-48ea-a9ba-b0e4e7f603d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:16 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-29cd2aaf-90f2-4277-8ebe-936c51c2ce85 tempest-VolumesSnapshotTestJSON-1738300856 None] Created volume successfully.
Apr 29 08:44:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Creating offline snapshot 1e777213-fe51-411f-9dbb-c0ff8c561ab1 of volume 61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:44:17 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1161bf-937f-4f3a-b907-1f25fc3fd82b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:17 devstack sudo[92225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c
Apr 29 08:44:17 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:17 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c" returned: 0 in 0.670s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:17 devstack sudo[92230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 1G
Apr 29 08:44:17 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:18 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 1G" returned: 0 in 0.740s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:18 devstack sudo[92235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1
Apr 29 08:44:18 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:19 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1" returned: 0 in 0.626s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:19 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 is being set with open permissions: ugo+rw
Apr 29 08:44:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:19 devstack sudo[92240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1
Apr 29 08:44:19 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:19 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1" returned: 0 in 0.570s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:19 devstack sudo[92243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.info
Apr 29 08:44:19 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:20 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.info" returned: 0 in 0.587s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:20 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.info is being set with open permissions: ugo+rw
Apr 29 08:44:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:20 devstack sudo[92246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.info
Apr 29 08:44:20 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:21 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.info" returned: 0 in 0.562s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.840s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:21 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3e3a1765-e707-4d1e-84f1-f0af2214f110 tempest-VolumesSnapshotTestJSON-1738300856 None] Create snapshot completed successfully
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (207c5dc2-f8d2-45e5-a3fd-29c52044c0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fab04e0-8012-478c-a9a3-5469cbed95e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fab04e0-8012-478c-a9a3-5469cbed95e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-693674568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e875926-2732-4a86-b3f4-799d4a287d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010c154bb93f4f0caa55b172d8e4c9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1e777213-fe51-411f-9dbb-c0ff8c561ab1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:22Z,use_quota=True,user_id='2a42c0db6afa4c28a7422b2c9a9264b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bd590f-8215-477e-9bd4-6a3a401d100d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bd590f-8215-477e-9bd4-6a3a401d100d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458ad179-6c3e-4962-9924-70222748dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458ad179-6c3e-4962-9924-70222748dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e875926-2732-4a86-b3f4-799d4a287d34', 'volume_name': 'volume-3e875926-2732-4a86-b3f4-799d4a287d34', 'volume_size': 2, 'snapshot_id': '1e777213-fe51-411f-9dbb-c0ff8c561ab1'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe48e64-e62c-434f-bfb7-497fc9ef2736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe48e64-e62c-434f-bfb7-497fc9ef2736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730fef62-2323-4dcd-b03a-e598e01a65f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Volume 3e875926-2732-4a86-b3f4-799d4a287d34: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e875926-2732-4a86-b3f4-799d4a287d34', 'volume_size': 2, 'snapshot_id': '1e777213-fe51-411f-9dbb-c0ff8c561ab1'}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-1e777213-fe51-411f-9dbb-c0ff8c561ab1-3e875926-2732-4a86-b3f4-799d4a287d34" by "_create_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-1e777213-fe51-411f-9dbb-c0ff8c561ab1-3e875926-2732-4a86-b3f4-799d4a287d34" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Creating volume 3e875926-2732-4a86-b3f4-799d4a287d34 from snapshot 1e777213-fe51-411f-9dbb-c0ff8c561ab1 {{(pid=83885) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-3e875926-2732-4a86-b3f4-799d4a287d34" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-3e875926-2732-4a86-b3f4-799d4a287d34" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] snapshot: 1e777213-fe51-411f-9dbb-c0ff8c561ab1, volume: 3e875926-2732-4a86-b3f4-799d4a287d34,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc70d29-05b3-4110-88c7-d3160c311ef2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:22 devstack sudo[92249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1
Apr 29 08:44:22 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:22 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1" returned: 0 in 0.682s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:44:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:44:22 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8448927-5ffb-406e-9ed6-a1483773d92d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:22 devstack sudo[92254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c
Apr 29 08:44:22 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:23 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c" returned: 0 in 0.692s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:23 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34 not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:44:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:23 devstack sudo[92260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34
Apr 29 08:44:23 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:27 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34" returned: 0 in 4.146s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:27 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b21bffa-5898-4128-92a2-bc2c1402bead]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:27 devstack sudo[92312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c
Apr 29 08:44:27 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:28 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c" returned: 0 in 0.835s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:44:28 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Converted 1024.00 MB image at 246.92 MB/s
Apr 29 08:44:28 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34 is being set with open permissions: ugo+rw
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:28 devstack sudo[92317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34
Apr 29 08:44:28 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:28 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34" returned: 0 in 0.554s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-3e875926-2732-4a86-b3f4-799d4a287d34" released by "_copy_volume_from_snapshot" :: held 6.990s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-1e777213-fe51-411f-9dbb-c0ff8c561ab1-3e875926-2732-4a86-b3f4-799d4a287d34" released by "_create_volume_from_snapshot" :: held 7.014s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.027s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730fef62-2323-4dcd-b03a-e598e01a65f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e875926-2732-4a86-b3f4-799d4a287d34', 'volume_size': 2, 'snapshot_id': '1e777213-fe51-411f-9dbb-c0ff8c561ab1'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d652d903-4e9a-4f4e-910b-a5414ef363a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:28 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Volume volume-3e875926-2732-4a86-b3f4-799d4a287d34 (3e875926-2732-4a86-b3f4-799d4a287d34): created successfully
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d652d903-4e9a-4f4e-910b-a5414ef363a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (207c5dc2-f8d2-45e5-a3fd-29c52044c0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:28 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ac363085-09b5-408a-9d90-dbec6e34d50a tempest-VolumesSnapshotTestJSON-1738300856 None] Created volume successfully.
Apr 29 08:44:29 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-3e875926-2732-4a86-b3f4-799d4a287d34-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:29 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-3e875926-2732-4a86-b3f4-799d4a287d34-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:29 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-3e875926-2732-4a86-b3f4-799d4a287d34" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:29 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-3e875926-2732-4a86-b3f4-799d4a287d34" acquired by "delete_volume" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:29 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a36663d-8d4b-475c-8cf2-c34e04b9f510]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:29 devstack sudo[92320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34
Apr 29 08:44:29 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:30 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34" returned: 0 in 0.668s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:30 devstack sudo[92325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34
Apr 29 08:44:30 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:30 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-3e875926-2732-4a86-b3f4-799d4a287d34" returned: 0 in 0.586s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-3e875926-2732-4a86-b3f4-799d4a287d34" released by "delete_volume" :: held 1.291s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Created reservations ['7a69b1a8-258b-4a17-a4b6-732ad448da86', '37740066-f985-42f1-9f80-0d88f011c3a7', '375c1c3a-c998-4a80-b3f2-45e8da6ae3e4', '2d0260ac-3fb5-43ba-802d-e7800f6a8e7c'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:30 devstack sudo[92328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:44:30 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:31 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.569s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:31 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Deleted volume successfully.
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-56ec5c39-bee7-4bbb-8125-b78817f64149 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-3e875926-2732-4a86-b3f4-799d4a287d34-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-1e777213-fe51-411f-9dbb-c0ff8c561ab1-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-1e777213-fe51-411f-9dbb-c0ff8c561ab1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-61fcf1ce-2c91-4f40-977e-2632e8e2763c" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-61fcf1ce-2c91-4f40-977e-2632e8e2763c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-1e777213-fe51-411f-9dbb-c0ff8c561ab1" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-1e777213-fe51-411f-9dbb-c0ff8c561ab1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Deleting offline snapshot 1e777213-fe51-411f-9dbb-c0ff8c561ab1 of volume 61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] snapshot_file for this snap is: volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df4d2c8-52f5-4c7a-ae7b-95b6d6f95d55]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:31 devstack sudo[92337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1
Apr 29 08:44:31 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:32 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1" returned: 0 in 0.663s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:32 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:32 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc3ed1b-e9a9-4f55-9196-2bfd8fe5ba85]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:32 devstack sudo[92342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c
Apr 29 08:44:32 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:33 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c" returned: 0 in 0.672s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:33 devstack sudo[92347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1
Apr 29 08:44:33 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:33 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1" returned: 0 in 0.665s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:33 devstack sudo[92353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1
Apr 29 08:44:33 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:34 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c.1e777213-fe51-411f-9dbb-c0ff8c561ab1" returned: 0 in 0.576s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-1e777213-fe51-411f-9dbb-c0ff8c561ab1" released by "_delete_snapshot" :: held 2.672s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-61fcf1ce-2c91-4f40-977e-2632e8e2763c" released by "delete_snapshot" :: held 2.698s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:34 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Created reservations ['981bfa91-5b66-4533-b67f-902e94538ce6', '3ba37699-d4e3-4220-b6ef-66c1d679dfe7', '5f49055c-1bd4-424d-8619-02d415c3ad8f', 'e40da310-742c-4892-9416-bec93c0422a5'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:34 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Delete snapshot completed successfully.
Apr 29 08:44:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ff552d6c-c4f4-45b7-b438-39fc8c1435f1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-1e777213-fe51-411f-9dbb-c0ff8c561ab1-delete_snapshot" released by "delete_snapshot" :: held 2.833s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-61fcf1ce-2c91-4f40-977e-2632e8e2763c-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-61fcf1ce-2c91-4f40-977e-2632e8e2763c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-61fcf1ce-2c91-4f40-977e-2632e8e2763c" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:34 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-61fcf1ce-2c91-4f40-977e-2632e8e2763c" acquired by "delete_volume" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:35 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b180e630-1c14-4f57-b90f-a51af9eaae7f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:35 devstack sudo[92356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c
Apr 29 08:44:35 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:35 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c" returned: 0 in 0.695s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:35 devstack sudo[92361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c
Apr 29 08:44:35 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:36 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-61fcf1ce-2c91-4f40-977e-2632e8e2763c" returned: 0 in 0.587s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-61fcf1ce-2c91-4f40-977e-2632e8e2763c" released by "delete_volume" :: held 1.349s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:36 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Created reservations ['520a57bb-8a07-4860-bc11-76e293d5c68f', 'ac4632b8-ab87-4028-bf7c-dbea2c1d2956', '4f98f62d-66ca-4417-92ff-dcb033dbfc56', '48aba19d-3bce-47ef-be1a-72d1d6f07f90'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:36 devstack sudo[92364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:44:36 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:37 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.561s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:37 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Deleted volume successfully.
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe2c4d23-3d21-4182-b74c-6a7d084345ae tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-61fcf1ce-2c91-4f40-977e-2632e8e2763c-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (a3c7cda0-0a8c-41f3-ac68-2e101338cc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8022336c-1f91-4191-8bd5-8804c4386bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8022336c-1f91-4191-8bd5-8804c4386bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1805043323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c419ebba-a234-4005-88c0-8afa142b4095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010c154bb93f4f0caa55b172d8e4c9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:38Z,use_quota=True,user_id='2a42c0db6afa4c28a7422b2c9a9264b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860c4c76-3115-484a-9ce8-4e22db5c7e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860c4c76-3115-484a-9ce8-4e22db5c7e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e64774-2279-4561-9633-a6950ac5020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e64774-2279-4561-9633-a6950ac5020d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c419ebba-a234-4005-88c0-8afa142b4095', 'volume_name': 'volume-c419ebba-a234-4005-88c0-8afa142b4095', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7884472-de00-49f2-9f9d-ae69dc5e6d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7884472-de00-49f2-9f9d-ae69dc5e6d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2beb093a-23cb-4a01-8ae1-0e11b662ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:37 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Volume c419ebba-a234-4005-88c0-8afa142b4095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c419ebba-a234-4005-88c0-8afa142b4095', 'volume_size': 1}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1805043323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c419ebba-a234-4005-88c0-8afa142b4095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010c154bb93f4f0caa55b172d8e4c9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:38Z,use_quota=True,user_id='2a42c0db6afa4c28a7422b2c9a9264b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Creating volume c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:37 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:44:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:37 devstack sudo[92367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 1073741824
Apr 29 08:44:37 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:38 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 1073741824" returned: 0 in 0.733s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:38 devstack sudo[92372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095
Apr 29 08:44:38 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:38 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095" returned: 0 in 0.596s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:38 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2beb093a-23cb-4a01-8ae1-0e11b662ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c419ebba-a234-4005-88c0-8afa142b4095', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725d09cc-e193-43d6-95d8-afee83e0a952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:39 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Volume volume-c419ebba-a234-4005-88c0-8afa142b4095 (c419ebba-a234-4005-88c0-8afa142b4095): created successfully
Apr 29 08:44:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725d09cc-e193-43d6-95d8-afee83e0a952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (a3c7cda0-0a8c-41f3-ac68-2e101338cc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:39 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-80c7cb56-4fd6-46f1-ba2e-309e305119f6 tempest-VolumesSnapshotTestJSON-1738300856 None] Created volume successfully.
Apr 29 08:44:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Creating offline snapshot b52cd0ef-13e1-4a04-ba4d-ca9d80791173 of volume c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:44:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e7a13-970a-46cc-a30e-d2401ba00ead]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:39 devstack sudo[92375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095
Apr 29 08:44:39 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:40 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095" returned: 0 in 0.692s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:40 devstack sudo[92380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 1G
Apr 29 08:44:40 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:41 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 1G" returned: 0 in 0.748s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c419ebba-a234-4005-88c0-8afa142b4095 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:41 devstack sudo[92385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c419ebba-a234-4005-88c0-8afa142b4095 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173
Apr 29 08:44:41 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:41 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c419ebba-a234-4005-88c0-8afa142b4095 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173" returned: 0 in 0.645s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:41 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 is being set with open permissions: ugo+rw
Apr 29 08:44:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:41 devstack sudo[92390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173
Apr 29 08:44:41 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:42 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173" returned: 0 in 0.578s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:42 devstack sudo[92393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.info
Apr 29 08:44:42 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:43 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.info" returned: 0 in 0.593s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:43 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.info is being set with open permissions: ugo+rw
Apr 29 08:44:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:43 devstack sudo[92396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.info
Apr 29 08:44:43 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:43 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.info" returned: 0 in 0.550s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.892s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:43 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-5903b230-54d7-436b-9a44-b3848e82578f tempest-VolumesSnapshotTestJSON-1738300856 None] Create snapshot completed successfully
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (df02c575-3c4c-4db2-a567-55278430ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdce6f5a-d28f-40af-b087-7303a23b6944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdce6f5a-d28f-40af-b087-7303a23b6944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1100199459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10edd3e2-f0ce-49ed-b421-75e9a0a2348d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='010c154bb93f4f0caa55b172d8e4c9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b52cd0ef-13e1-4a04-ba4d-ca9d80791173,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:44Z,use_quota=True,user_id='2a42c0db6afa4c28a7422b2c9a9264b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d79fa79-72eb-4a05-a375-f14c043b7657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d79fa79-72eb-4a05-a375-f14c043b7657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3718b964-3df0-4ddf-b34f-7234b451df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3718b964-3df0-4ddf-b34f-7234b451df48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '10edd3e2-f0ce-49ed-b421-75e9a0a2348d', 'volume_name': 'volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d', 'volume_size': 1, 'snapshot_id': 'b52cd0ef-13e1-4a04-ba4d-ca9d80791173'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465d340a-8258-41ed-9d15-ffab43dc0e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465d340a-8258-41ed-9d15-ffab43dc0e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae632b6d-109a-423a-bfc0-60fe01b556e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:44 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Volume 10edd3e2-f0ce-49ed-b421-75e9a0a2348d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d', 'volume_size': 1, 'snapshot_id': 'b52cd0ef-13e1-4a04-ba4d-ca9d80791173'}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-b52cd0ef-13e1-4a04-ba4d-ca9d80791173-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" by "_create_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-b52cd0ef-13e1-4a04-ba4d-ca9d80791173-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Creating volume 10edd3e2-f0ce-49ed-b421-75e9a0a2348d from snapshot b52cd0ef-13e1-4a04-ba4d-ca9d80791173 {{(pid=83885) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] snapshot: b52cd0ef-13e1-4a04-ba4d-ca9d80791173, volume: 10edd3e2-f0ce-49ed-b421-75e9a0a2348d,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d3273e-229b-41b1-9340-bda164118c8a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:44 devstack sudo[92400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173
Apr 29 08:44:44 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:45 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173" returned: 0 in 0.658s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c419ebba-a234-4005-88c0-8afa142b4095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:44:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:44:45 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a003c166-1ced-4e51-8b48-ffe9527e7c5b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:45 devstack sudo[92405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095
Apr 29 08:44:45 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:45 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095" returned: 0 in 0.685s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:45 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:44:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:45 devstack sudo[92410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d
Apr 29 08:44:45 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:44:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:49 devstack sudo[92423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:44:49 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:50 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" returned: 0 in 4.217s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:50 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2513c55-c97a-4582-8bcb-6ea0bae7bc9b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:50 devstack sudo[92425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095
Apr 29 08:44:50 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:50 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.650s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:50 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095" returned: 0 in 0.848s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:50 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:44:50 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Converted 1024.00 MB image at 242.70 MB/s
Apr 29 08:44:50 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d is being set with open permissions: ugo+rw
Apr 29 08:44:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:51 devstack sudo[92431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d
Apr 29 08:44:51 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:51 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" returned: 0 in 0.584s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" released by "_copy_volume_from_snapshot" :: held 7.072s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-b52cd0ef-13e1-4a04-ba4d-ca9d80791173-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" released by "_create_volume_from_snapshot" :: held 7.100s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.112s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae632b6d-109a-423a-bfc0-60fe01b556e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d', 'volume_size': 1, 'snapshot_id': 'b52cd0ef-13e1-4a04-ba4d-ca9d80791173'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209440a5-b7ac-4743-9b20-80d32f57813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:51 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Volume volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d (10edd3e2-f0ce-49ed-b421-75e9a0a2348d): created successfully
Apr 29 08:44:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209440a5-b7ac-4743-9b20-80d32f57813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Flow 'volume_create_manager' (df02c575-3c4c-4db2-a567-55278430ad99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:51 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e4ce2050-cf4e-4352-abea-f15bb31dcb3a tempest-VolumesSnapshotTestJSON-1738300856 None] Created volume successfully.
Apr 29 08:44:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-10edd3e2-f0ce-49ed-b421-75e9a0a2348d-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-10edd3e2-f0ce-49ed-b421-75e9a0a2348d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" acquired by "delete_volume" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:52 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b34f5d-9681-4e57-ab28-d8343d1746ec]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:52 devstack sudo[92434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d
Apr 29 08:44:52 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:52 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" returned: 0 in 0.682s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:52 devstack sudo[92439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d
Apr 29 08:44:52 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:53 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" returned: 0 in 0.576s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-10edd3e2-f0ce-49ed-b421-75e9a0a2348d" released by "delete_volume" :: held 1.296s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:53 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Created reservations ['9ca11f4b-4943-43b6-8ab3-ee15c38d7d0c', '94e243b2-98f9-470f-9cf8-5cdb4e388046', 'a1df4296-2d99-42f3-a5c1-05b5b3be5024', 'bf0a458e-40e8-4bf0-a1d8-c4a405cb3259'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:53 devstack sudo[92443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:44:53 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:54 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.577s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:54 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Deleted volume successfully.
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-58234b01-93f9-44c3-bb40-5f177e53b95e tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-10edd3e2-f0ce-49ed-b421-75e9a0a2348d-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-b52cd0ef-13e1-4a04-ba4d-ca9d80791173-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-b52cd0ef-13e1-4a04-ba4d-ca9d80791173-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-c419ebba-a234-4005-88c0-8afa142b4095" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-c419ebba-a234-4005-88c0-8afa142b4095" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-b52cd0ef-13e1-4a04-ba4d-ca9d80791173" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-b52cd0ef-13e1-4a04-ba4d-ca9d80791173" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Deleting offline snapshot b52cd0ef-13e1-4a04-ba4d-ca9d80791173 of volume c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] snapshot_file for this snap is: volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfcc2ce-6851-4af8-946f-0e04435c2a1b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:54 devstack sudo[92446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173
Apr 29 08:44:54 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:55 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173" returned: 0 in 0.703s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c419ebba-a234-4005-88c0-8afa142b4095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:55 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[28936ef4-9438-4f41-9527-f49a93dc5270]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:55 devstack sudo[92451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095
Apr 29 08:44:55 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:55 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095" returned: 0 in 0.686s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:55 devstack sudo[92456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173
Apr 29 08:44:55 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:56 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173" returned: 0 in 0.678s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:56 devstack sudo[92461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173
Apr 29 08:44:56 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:57 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095.b52cd0ef-13e1-4a04-ba4d-ca9d80791173" returned: 0 in 0.565s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-b52cd0ef-13e1-4a04-ba4d-ca9d80791173" released by "_delete_snapshot" :: held 2.732s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-c419ebba-a234-4005-88c0-8afa142b4095" released by "delete_snapshot" :: held 2.753s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Created reservations ['cfaacfe3-170f-455d-aa45-bcf5dd74de16', '94e7e8e1-fc8f-4e97-ab74-0e85f0f7cd3c', '3f392b7a-2efc-4882-b013-5fa855188bda', 'd16e753a-5938-4d43-a5ec-86b52287bf4f'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:57 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Delete snapshot completed successfully.
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-93d1d4e5-95bf-4fe4-9829-cc253536d622 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-b52cd0ef-13e1-4a04-ba4d-ca9d80791173-delete_snapshot" released by "delete_snapshot" :: held 2.883s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-c419ebba-a234-4005-88c0-8afa142b4095-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-c419ebba-a234-4005-88c0-8afa142b4095-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-c419ebba-a234-4005-88c0-8afa142b4095" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-c419ebba-a234-4005-88c0-8afa142b4095" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[5354e181-06b3-4393-af27-4a2de779090f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:57 devstack sudo[92464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095
Apr 29 08:44:57 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:58 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095" returned: 0 in 0.669s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:58 devstack sudo[92469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095
Apr 29 08:44:58 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:58 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c419ebba-a234-4005-88c0-8afa142b4095" returned: 0 in 0.557s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-c419ebba-a234-4005-88c0-8afa142b4095" released by "delete_volume" :: held 1.290s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:58 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Created reservations ['3ccf0e36-5761-4f7b-a0ee-619773adf386', 'f54cb3fc-7800-4e28-8cc0-88f22a796765', '67ffcaa2-b3d9-40c9-a391-b356b0d6a592', '253e9000-62e2-45f5-8997-990fa0ecdd25'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:59 devstack sudo[92472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:44:59 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:59 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.547s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:59 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Deleted volume successfully.
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-84e7b25a-8850-403d-bf0f-bc0ab59599b1 tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-c419ebba-a234-4005-88c0-8afa142b4095-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-d801eab3-60c7-489d-b3cb-3c7ac575bd4b-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-d801eab3-60c7-489d-b3cb-3c7ac575bd4b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "cinder-quobyte-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e4a149-854f-49ec-82ae-baf17411b9b9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:59 devstack sudo[92475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b
Apr 29 08:45:00 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:00 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" returned: 0 in 0.674s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:00 devstack sudo[92480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b
Apr 29 08:45:00 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:01 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" returned: 0 in 0.570s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-quobyte-d801eab3-60c7-489d-b3cb-3c7ac575bd4b" released by "delete_volume" :: held 1.297s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Created reservations ['42dab9af-fd40-4d1f-b4cf-c0358e82285c', 'fd6c0fb2-8e38-438f-8fd1-bb4e2402d82b', '22226579-272b-4c42-b91a-77b7428c3b86', '71cdad9e-cd9e-48d9-9db2-0776e78ccdc3'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:01 devstack sudo[92486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:45:01 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:01 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.591s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Deleted volume successfully.
Apr 29 08:45:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-3e13f877-936c-4981-a893-b14e81aded5f tempest-VolumesSnapshotTestJSON-1738300856 None] Lock "cinder-d801eab3-60c7-489d-b3cb-3c7ac575bd4b-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=66,cinder:UPDATE=74,cinder:INSERT=18,cinder:DELETE=6 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=77,cinder:SELECT=74,cinder:INSERT=20,cinder:DELETE=7 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Flow 'volume_create_manager' (e4c0d5f8-228c-4c4b-a1ba-6d8f8fca410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3618d0b0-f41e-4ea0-8506-3ddd5ff98d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3618d0b0-f41e-4ea0-8506-3ddd5ff98d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68077f80-2705-4dfe-affc-e0d4e87faf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3bacb5c7f249dc9c5447badb43932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:07Z,use_quota=True,user_id='ab917384861949b1a63b06d4fab529da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2222a1a-f372-4615-b29e-7ce506e97a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2222a1a-f372-4615-b29e-7ce506e97a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2a58cb-769d-4deb-9d93-291a897b71a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2a58cb-769d-4deb-9d93-291a897b71a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68077f80-2705-4dfe-affc-e0d4e87faf24', 'volume_name': 'volume-68077f80-2705-4dfe-affc-e0d4e87faf24', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0d1c63-71ac-4826-9137-7c9634dd50bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0d1c63-71ac-4826-9137-7c9634dd50bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc57d99-6f5b-44f2-9a04-ccf406eee519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:07 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Volume 68077f80-2705-4dfe-affc-e0d4e87faf24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68077f80-2705-4dfe-affc-e0d4e87faf24', 'volume_size': 1}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68077f80-2705-4dfe-affc-e0d4e87faf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3bacb5c7f249dc9c5447badb43932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:07Z,use_quota=True,user_id='ab917384861949b1a63b06d4fab529da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Creating volume 68077f80-2705-4dfe-affc-e0d4e87faf24 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:07 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:07 devstack sudo[92493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24 1073741824
Apr 29 08:45:07 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:07 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24 1073741824" returned: 0 in 0.750s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:08 devstack sudo[92499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24
Apr 29 08:45:08 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:08 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24" returned: 0 in 0.582s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc57d99-6f5b-44f2-9a04-ccf406eee519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68077f80-2705-4dfe-affc-e0d4e87faf24', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26859417-a1da-4501-980a-895448fbf1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:08 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Volume volume-68077f80-2705-4dfe-affc-e0d4e87faf24 (68077f80-2705-4dfe-affc-e0d4e87faf24): created successfully
Apr 29 08:45:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26859417-a1da-4501-980a-895448fbf1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Flow 'volume_create_manager' (e4c0d5f8-228c-4c4b-a1ba-6d8f8fca410d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:08 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-7d51a234-bf7a-4691-a96a-d4aca2f03f4d tempest-CinderUnicodeTest-1259251755 None] Created volume successfully.
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Flow 'volume_create_manager' (017794af-59d7-4c2d-be99-5a20d9162226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3658999-b85a-4a74-820d-3542a9e73b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3658999-b85a-4a74-820d-3542a9e73b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-306403936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a0ffd8-9e06-45fc-956b-8083ee33203b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3bacb5c7f249dc9c5447badb43932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:10Z,use_quota=True,user_id='ab917384861949b1a63b06d4fab529da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af3d67d-a0bd-4c9e-b883-cea31d11a868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af3d67d-a0bd-4c9e-b883-cea31d11a868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562f4e95-35ff-47ec-bf06-0955f55ef266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562f4e95-35ff-47ec-bf06-0955f55ef266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a0ffd8-9e06-45fc-956b-8083ee33203b', 'volume_name': 'volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fe8afe-9d4d-4f97-b756-79c0d520d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fe8afe-9d4d-4f97-b756-79c0d520d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644a7258-e679-411c-ada0-c86fc1191966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:09 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Volume f1a0ffd8-9e06-45fc-956b-8083ee33203b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b', 'volume_size': 1}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-306403936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a0ffd8-9e06-45fc-956b-8083ee33203b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3bacb5c7f249dc9c5447badb43932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:10Z,use_quota=True,user_id='ab917384861949b1a63b06d4fab529da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Creating volume f1a0ffd8-9e06-45fc-956b-8083ee33203b {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:09 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:45:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:09 devstack sudo[92502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b 1073741824
Apr 29 08:45:09 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:10 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b 1073741824" returned: 0 in 0.764s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:10 devstack sudo[92508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b
Apr 29 08:45:10 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:11 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b" returned: 0 in 0.631s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644a7258-e679-411c-ada0-c86fc1191966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461167e3-0143-46fa-93cc-b41ff20079c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:11 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Volume volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b (f1a0ffd8-9e06-45fc-956b-8083ee33203b): created successfully
Apr 29 08:45:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461167e3-0143-46fa-93cc-b41ff20079c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Flow 'volume_create_manager' (017794af-59d7-4c2d-be99-5a20d9162226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:11 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d02c5d3d-2cf7-4743-91dc-164c50868fe5 tempest-CinderUnicodeTest-1259251755 None] Created volume successfully.
Apr 29 08:45:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:12 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Creating offline snapshot efb8ea13-09b6-4d39-b973-87c0c40b2766 of volume f1a0ffd8-9e06-45fc-956b-8083ee33203b {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:45:12 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed69ff5-68ba-4d43-9d36-b2d11c00912a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:12 devstack sudo[92511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b
Apr 29 08:45:12 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:12 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b" returned: 0 in 0.749s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:12 devstack sudo[92519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 1G
Apr 29 08:45:12 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:13 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 1G" returned: 0 in 0.744s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:13 devstack sudo[92525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766
Apr 29 08:45:13 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:14 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766" returned: 0 in 0.699s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:14 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 is being set with open permissions: ugo+rw
Apr 29 08:45:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:14 devstack sudo[92530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766
Apr 29 08:45:14 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:14 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766" returned: 0 in 0.591s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:14 devstack sudo[92533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.info
Apr 29 08:45:14 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:15 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.info" returned: 0 in 0.626s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:15 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.info is being set with open permissions: ugo+rw
Apr 29 08:45:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:15 devstack sudo[92536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.info
Apr 29 08:45:15 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:16 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.info" returned: 0 in 0.576s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.069s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:16 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-722bc963-8eff-4060-8da8-ebcb14f1186a tempest-CinderUnicodeTest-1259251755 None] Create snapshot completed successfully
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "cinder-efb8ea13-09b6-4d39-b973-87c0c40b2766-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-efb8ea13-09b6-4d39-b973-87c0c40b2766-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "cinder-quobyte-f1a0ffd8-9e06-45fc-956b-8083ee33203b" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-quobyte-f1a0ffd8-9e06-45fc-956b-8083ee33203b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "cinder-quobyte-efb8ea13-09b6-4d39-b973-87c0c40b2766" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-quobyte-efb8ea13-09b6-4d39-b973-87c0c40b2766" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Deleting offline snapshot efb8ea13-09b6-4d39-b973-87c0c40b2766 of volume f1a0ffd8-9e06-45fc-956b-8083ee33203b {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] snapshot_file for this snap is: volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7357362d-fb70-4b82-9e07-50ab43f59e2e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:17 devstack sudo[92539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766
Apr 29 08:45:17 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:18 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766" returned: 0 in 0.697s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:45:18 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d06286e-5df6-47de-8120-9bc518459b4a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:18 devstack sudo[92544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b
Apr 29 08:45:18 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:18 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b" returned: 0 in 0.680s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:18 devstack sudo[92549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766
Apr 29 08:45:18 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:19 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766" returned: 0 in 0.642s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:19 devstack sudo[92554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766
Apr 29 08:45:19 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:19 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b.efb8ea13-09b6-4d39-b973-87c0c40b2766" returned: 0 in 0.559s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-quobyte-efb8ea13-09b6-4d39-b973-87c0c40b2766" released by "_delete_snapshot" :: held 2.681s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-quobyte-f1a0ffd8-9e06-45fc-956b-8083ee33203b" released by "delete_snapshot" :: held 2.702s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:20 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Created reservations ['b56a2136-18ee-4567-b2af-281e8d762da4', '44483e0f-3e22-4654-8d20-7fbf553603d2', 'b5d15885-555d-481f-a725-9268f46b675f', '195ba377-ac36-4814-9646-d4f394247a14'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:20 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Delete snapshot completed successfully.
Apr 29 08:45:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fe631630-0596-45cc-96f7-e20e20959235 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-efb8ea13-09b6-4d39-b973-87c0c40b2766-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "cinder-f1a0ffd8-9e06-45fc-956b-8083ee33203b-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-f1a0ffd8-9e06-45fc-956b-8083ee33203b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "cinder-quobyte-f1a0ffd8-9e06-45fc-956b-8083ee33203b" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-quobyte-f1a0ffd8-9e06-45fc-956b-8083ee33203b" acquired by "delete_volume" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:20 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3271cbdd-103d-400e-a7a5-90858eecc080]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:20 devstack sudo[92557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b
Apr 29 08:45:20 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:21 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b" returned: 0 in 0.732s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:21 devstack sudo[92562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b
Apr 29 08:45:21 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:21 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-f1a0ffd8-9e06-45fc-956b-8083ee33203b" returned: 0 in 0.644s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-quobyte-f1a0ffd8-9e06-45fc-956b-8083ee33203b" released by "delete_volume" :: held 1.438s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Created reservations ['077e2ede-cd48-468d-a123-7e338b16ba03', 'ac4da818-6f1f-417d-beb3-604171304e10', '55d7d3f6-ede5-42b8-b375-cb48f8907a42', '663332e4-439f-49a3-a6d3-ae1102e4a5fc'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:22 devstack sudo[92565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:45:22 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "cinder-68077f80-2705-4dfe-affc-e0d4e87faf24-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:22 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.595s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-68077f80-2705-4dfe-affc-e0d4e87faf24-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:22 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Deleted volume successfully.
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-717394b5-dfe2-41f3-b491-db0fe95c09d1 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-f1a0ffd8-9e06-45fc-956b-8083ee33203b-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "cinder-quobyte-68077f80-2705-4dfe-affc-e0d4e87faf24" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-quobyte-68077f80-2705-4dfe-affc-e0d4e87faf24" acquired by "delete_volume" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[93520e58-fec3-474b-97f6-bc4683b650db]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:22 devstack sudo[92569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24
Apr 29 08:45:22 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:23 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24" returned: 0 in 0.703s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:23 devstack sudo[92575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24
Apr 29 08:45:23 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:24 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-68077f80-2705-4dfe-affc-e0d4e87faf24" returned: 0 in 0.586s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-quobyte-68077f80-2705-4dfe-affc-e0d4e87faf24" released by "delete_volume" :: held 1.327s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Created reservations ['3a7c2665-ad70-4b71-be39-ceb7c3413e4d', '7b613666-225e-413b-96d9-c2a95eaf14d5', '5b8536d1-cf78-44e8-b6ab-c047ce1048ae', '2e92cc5f-4c60-4302-84d0-8bb1cf64555a'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:24 devstack sudo[92614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:45:24 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:24 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.564s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:24 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Deleted volume successfully.
Apr 29 08:45:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a34ecb59-bf78-4a5c-9b73-574aa18ba904 tempest-CinderUnicodeTest-1259251755 None] Lock "cinder-68077f80-2705-4dfe-affc-e0d4e87faf24-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:34 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=25,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:45:34 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=20,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=8 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:45:46 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:45:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Flow 'volume_create_manager' (ed6990c5-f4f1-4566-8522-309b2a4df2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bdee79-d991-4217-a173-34b1247b1639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bdee79-d991-4217-a173-34b1247b1639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1514392998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed4ed1c-aa11-4026-a835-660a749362d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69aca056cefc4f729a8664e720061708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:47Z,use_quota=True,user_id='30971160164040e196e9f80f32a7db2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f82220-3f58-441a-a6c4-58f88432082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f82220-3f58-441a-a6c4-58f88432082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84731c6-5ba2-4d48-9db9-6115b21fc6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:46 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84731c6-5ba2-4d48-9db9-6115b21fc6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed4ed1c-aa11-4026-a835-660a749362d8', 'volume_name': 'volume-1ed4ed1c-aa11-4026-a835-660a749362d8', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a7bb3f-62a1-4114-a5c7-ccb8ce610acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a7bb3f-62a1-4114-a5c7-ccb8ce610acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07277859-1eef-4613-8529-95b058ef4863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:47 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Volume 1ed4ed1c-aa11-4026-a835-660a749362d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed4ed1c-aa11-4026-a835-660a749362d8', 'volume_size': 1}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1514392998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed4ed1c-aa11-4026-a835-660a749362d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69aca056cefc4f729a8664e720061708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:47Z,use_quota=True,user_id='30971160164040e196e9f80f32a7db2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Creating volume 1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:47 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:47 devstack sudo[92628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 1073741824
Apr 29 08:45:47 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:47 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 1073741824" returned: 0 in 0.729s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:47 devstack sudo[92633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8
Apr 29 08:45:47 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:48 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8" returned: 0 in 0.593s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07277859-1eef-4613-8529-95b058ef4863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed4ed1c-aa11-4026-a835-660a749362d8', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91669bf-c633-4671-8c02-dc80d5901072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:48 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Volume volume-1ed4ed1c-aa11-4026-a835-660a749362d8 (1ed4ed1c-aa11-4026-a835-660a749362d8): created successfully
Apr 29 08:45:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91669bf-c633-4671-8c02-dc80d5901072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:48 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Flow 'volume_create_manager' (ed6990c5-f4f1-4566-8522-309b2a4df2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:48 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d9c5b7d7-83be-4919-b42e-343cd842476e tempest-SnapshotDependencyTests-1263477293 None] Created volume successfully.
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Creating offline snapshot a889aa39-2851-4add-9fd8-c51a804feb80 of volume 1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e230b-f084-4964-9801-0c02b7cba485]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:49 devstack sudo[92636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8
Apr 29 08:45:49 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:49 devstack sudo[92638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:45:49 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:50 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8" returned: 0 in 0.692s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:50 devstack sudo[92643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 1G
Apr 29 08:45:50 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:50 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.614s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:50 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 1G" returned: 0 in 0.730s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed4ed1c-aa11-4026-a835-660a749362d8 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:50 devstack sudo[92649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed4ed1c-aa11-4026-a835-660a749362d8 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80
Apr 29 08:45:50 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:51 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed4ed1c-aa11-4026-a835-660a749362d8 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80" returned: 0 in 0.634s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:51 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 is being set with open permissions: ugo+rw
Apr 29 08:45:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:51 devstack sudo[92655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80
Apr 29 08:45:51 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:51 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80" returned: 0 in 0.603s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:52 devstack sudo[92658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.info
Apr 29 08:45:52 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:52 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.info" returned: 0 in 0.586s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:52 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.info is being set with open permissions: ugo+rw
Apr 29 08:45:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:52 devstack sudo[92661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.info
Apr 29 08:45:52 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:53 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.info" returned: 0 in 0.583s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.915s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:53 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-fb629e92-9ea2-4577-9c77-9cce3190bd41 tempest-SnapshotDependencyTests-1263477293 None] Create snapshot completed successfully
Apr 29 08:45:53 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Flow 'volume_create_manager' (f84a584d-d22c-4bb0-b112-13937522092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88eef6b-0ba1-4aa2-a3fc-608185d03556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88eef6b-0ba1-4aa2-a3fc-608185d03556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c80b6f9-7c4d-4ef7-a3ad-8432fd408489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69aca056cefc4f729a8664e720061708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a889aa39-2851-4add-9fd8-c51a804feb80,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:54Z,use_quota=True,user_id='30971160164040e196e9f80f32a7db2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5129b1-7578-41a9-9cc5-084819757700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5129b1-7578-41a9-9cc5-084819757700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17349267-511b-4e87-a458-c2035b3f1875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17349267-511b-4e87-a458-c2035b3f1875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c80b6f9-7c4d-4ef7-a3ad-8432fd408489', 'volume_name': 'volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489', 'volume_size': 1, 'snapshot_id': 'a889aa39-2851-4add-9fd8-c51a804feb80'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a334bc-0904-41a2-a4aa-96253c089fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a334bc-0904-41a2-a4aa-96253c089fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e37a8f-6d4b-4800-b246-e137d35960f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:54 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Volume 4c80b6f9-7c4d-4ef7-a3ad-8432fd408489: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489', 'volume_size': 1, 'snapshot_id': 'a889aa39-2851-4add-9fd8-c51a804feb80'}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "cinder-quobyte-a889aa39-2851-4add-9fd8-c51a804feb80-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" by "_create_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-a889aa39-2851-4add-9fd8-c51a804feb80-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Creating volume 4c80b6f9-7c4d-4ef7-a3ad-8432fd408489 from snapshot a889aa39-2851-4add-9fd8-c51a804feb80 {{(pid=83885) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "cinder-quobyte-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] snapshot: a889aa39-2851-4add-9fd8-c51a804feb80, volume: 4c80b6f9-7c4d-4ef7-a3ad-8432fd408489,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdee905-6edf-48ac-a122-cf732c6fe516]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:54 devstack sudo[92665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80
Apr 29 08:45:54 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:54 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80" returned: 0 in 0.678s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed4ed1c-aa11-4026-a835-660a749362d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b173aa-2e32-40e0-90c2-306c04301f8a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:54 devstack sudo[92670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8
Apr 29 08:45:54 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:55 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8" returned: 0 in 0.661s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:55 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489 not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:45:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:55 devstack sudo[92675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489
Apr 29 08:45:55 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:59 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" returned: 0 in 4.091s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:59 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b02a56-3c8f-4a24-b4cf-4e3056668a09]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:59 devstack sudo[92688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8
Apr 29 08:45:59 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:00 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8" returned: 0 in 0.795s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:00 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:46:00 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Converted 1024.00 MB image at 250.24 MB/s
Apr 29 08:46:00 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489 is being set with open permissions: ugo+rw
Apr 29 08:46:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:00 devstack sudo[92693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489
Apr 29 08:46:00 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:00 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" returned: 0 in 0.545s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" released by "_copy_volume_from_snapshot" :: held 6.846s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-a889aa39-2851-4add-9fd8-c51a804feb80-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" released by "_create_volume_from_snapshot" :: held 6.873s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.889s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e37a8f-6d4b-4800-b246-e137d35960f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489', 'volume_size': 1, 'snapshot_id': 'a889aa39-2851-4add-9fd8-c51a804feb80'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b289d6e-b9eb-494c-9d08-ae6bbe2dd5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:01 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Volume volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489 (4c80b6f9-7c4d-4ef7-a3ad-8432fd408489): created successfully
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b289d6e-b9eb-494c-9d08-ae6bbe2dd5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Flow 'volume_create_manager' (f84a584d-d22c-4bb0-b112-13937522092e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:01 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d197cf5c-cad5-439a-a44f-27f0d1417525 tempest-SnapshotDependencyTests-1263477293 None] Created volume successfully.
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "cinder-a889aa39-2851-4add-9fd8-c51a804feb80-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-a889aa39-2851-4add-9fd8-c51a804feb80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "cinder-quobyte-1ed4ed1c-aa11-4026-a835-660a749362d8" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-1ed4ed1c-aa11-4026-a835-660a749362d8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "cinder-quobyte-a889aa39-2851-4add-9fd8-c51a804feb80" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-a889aa39-2851-4add-9fd8-c51a804feb80" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Deleting offline snapshot a889aa39-2851-4add-9fd8-c51a804feb80 of volume 1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] snapshot_file for this snap is: volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eae91d-e108-4863-a0af-eee0e73a829b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:01 devstack sudo[92696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80
Apr 29 08:46:01 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:02 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80" returned: 0 in 0.692s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed4ed1c-aa11-4026-a835-660a749362d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:46:02 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9a24d5-e7f2-4d29-ad14-2ae4f6bca120]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:02 devstack sudo[92701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8
Apr 29 08:46:02 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:03 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8" returned: 0 in 0.686s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:03 devstack sudo[92707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80
Apr 29 08:46:03 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:03 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80" returned: 0 in 0.653s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:03 devstack sudo[92713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80
Apr 29 08:46:03 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:04 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8.a889aa39-2851-4add-9fd8-c51a804feb80" returned: 0 in 0.578s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-a889aa39-2851-4add-9fd8-c51a804feb80" released by "_delete_snapshot" :: held 2.707s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-1ed4ed1c-aa11-4026-a835-660a749362d8" released by "delete_snapshot" :: held 2.729s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Created reservations ['f6f083cf-cef9-40b6-8266-0bb862426484', '87147e2e-b4df-4ba9-a213-576cd5b9cf18', '3455396d-7238-4f0c-811e-2efc3ae3d358', '5688c93d-c4f3-4b27-bc9d-3d56cda0b466'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:04 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Delete snapshot completed successfully.
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6b0a13a7-d0a1-4334-934f-7183973c4143 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-a889aa39-2851-4add-9fd8-c51a804feb80-delete_snapshot" released by "delete_snapshot" :: held 2.864s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "cinder-1ed4ed1c-aa11-4026-a835-660a749362d8-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-1ed4ed1c-aa11-4026-a835-660a749362d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "cinder-quobyte-1ed4ed1c-aa11-4026-a835-660a749362d8" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-1ed4ed1c-aa11-4026-a835-660a749362d8" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[019daf18-eb27-4acf-ba4f-f0ac7d3b377b]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:05 devstack sudo[92716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8
Apr 29 08:46:05 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:05 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8" returned: 0 in 0.687s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:05 devstack sudo[92721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8
Apr 29 08:46:05 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:06 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-1ed4ed1c-aa11-4026-a835-660a749362d8" returned: 0 in 0.577s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-1ed4ed1c-aa11-4026-a835-660a749362d8" released by "delete_volume" :: held 1.320s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Created reservations ['1daaef71-1249-46b0-b378-9938a5a9fc21', '72561ee3-9d4e-4808-832c-b9a58b415999', 'c0f31427-c982-4819-a7a4-ebe602f39831', 'e5e7801e-61d0-4f58-b7e0-830def58c4f3'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:06 devstack sudo[92724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:46:06 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:06 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.551s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Deleted volume successfully.
Apr 29 08:46:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a91a9b21-a8f3-40e9-8943-62e028ffa313 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-1ed4ed1c-aa11-4026-a835-660a749362d8-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "cinder-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "cinder-quobyte-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:07 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b84798-411e-453d-9f38-09ba9e64446d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:07 devstack sudo[92727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489
Apr 29 08:46:07 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:07 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" returned: 0 in 0.685s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:07 devstack sudo[92732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489
Apr 29 08:46:07 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:08 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" returned: 0 in 0.577s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:08 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-quobyte-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489" released by "delete_volume" :: held 1.302s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:08 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Created reservations ['f8643e4d-fb36-45d0-a2f5-6cf5afabebd0', 'a8ac6ef9-b536-4f8e-b7d2-d20f0a8390bc', '634e51e2-0aea-49de-a73b-a386a6b06a6d', '5deb2ec8-1c23-4f9d-9355-16ef7addf448'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:08 devstack sudo[92735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:46:08 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:09 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.580s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:09 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Deleted volume successfully.
Apr 29 08:46:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-05cfcf58-a3c0-468b-8feb-79092c5ab341 tempest-SnapshotDependencyTests-1263477293 None] Lock "cinder-4c80b6f9-7c4d-4ef7-a3ad-8432fd408489-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:18 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=23,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=7 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:46:19 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=26,cinder:SELECT=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Flow 'volume_create_manager' (201b464b-b9b5-46ad-8e1f-7928fbd920f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3b48b3-0826-4187-b6c3-cd0cc0f582c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3b48b3-0826-4187-b6c3-cd0cc0f582c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1704294846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5ae678-ff8e-451c-960d-1f08cbb323b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c0195a81b74ea8903de4b453826710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:27Z,use_quota=True,user_id='ca72234a7e2242f7a1263c9acb9dcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e5bcbf-ddf7-4688-99b5-3910c7100fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e5bcbf-ddf7-4688-99b5-3910c7100fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4574bdb-a071-4f86-9899-667bb309d6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4574bdb-a071-4f86-9899-667bb309d6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5ae678-ff8e-451c-960d-1f08cbb323b1', 'volume_name': 'volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f46d678-560c-49d5-a7ed-d3ada71c011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f46d678-560c-49d5-a7ed-d3ada71c011b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7efe6c-77d6-4cbc-b6a6-a7e603c1e84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Volume fe5ae678-ff8e-451c-960d-1f08cbb323b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1', 'volume_size': 1}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1704294846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5ae678-ff8e-451c-960d-1f08cbb323b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c0195a81b74ea8903de4b453826710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:27Z,use_quota=True,user_id='ca72234a7e2242f7a1263c9acb9dcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Creating volume fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:27 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:27 devstack sudo[92826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 1073741824
Apr 29 08:46:27 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (c5416094-9f21-49fe-a48d-e4e434808d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a3189a-5a6e-404d-afe0-5e4d823721e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a3189a-5a6e-404d-afe0-5e4d823721e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159953522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172a7fe5-d3e7-42a2-b43f-5c692bcb5144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:27Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406b9af6-6371-4a00-9dfe-7877c2544307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406b9af6-6371-4a00-9dfe-7877c2544307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f142964d-d06f-415f-a233-a2da1fa01f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f142964d-d06f-415f-a233-a2da1fa01f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172a7fe5-d3e7-42a2-b43f-5c692bcb5144', 'volume_name': 'volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb5c3e5-e046-43e2-9efa-f50101a48fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb5c3e5-e046-43e2-9efa-f50101a48fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041ab2a0-8dd9-4e88-9c06-9f6f22409274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:27 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume 172a7fe5-d3e7-42a2-b43f-5c692bcb5144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144', 'volume_size': 1}
Apr 29 08:46:27 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (243e24cd-b1d7-4b6d-8515-912ab7184dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de50cf87-cb98-4d58-ae48-1fbdc316f150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de50cf87-cb98-4d58-ae48-1fbdc316f150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-274055204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874181b3-8be2-4eb3-8c4c-8f06c83258e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:28Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd4fc34b-972f-4ee1-a18f-61b4f6a7e3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd4fc34b-972f-4ee1-a18f-61b4f6a7e3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61bdafd-7a95-4b4c-ae44-526d3820c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61bdafd-7a95-4b4c-ae44-526d3820c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874181b3-8be2-4eb3-8c4c-8f06c83258e0', 'volume_name': 'volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fb3334-ff9f-464f-86da-9ef0cc7374f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fb3334-ff9f-464f-86da-9ef0cc7374f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c85dc24-476d-4a29-9e42-7013291a1fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Volume 874181b3-8be2-4eb3-8c4c-8f06c83258e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0', 'volume_size': 1}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (624649bb-8a87-41b0-a63f-c3f2eb5133ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ac0276-f1a4-41d5-960f-9f628f764c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ac0276-f1a4-41d5-960f-9f628f764c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-781592773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110ed091-7608-4209-8975-fcf2befda5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:28Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7402646-b07e-4ef9-8297-786ffe45edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7402646-b07e-4ef9-8297-786ffe45edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84527f16-b70f-419c-8c88-0f77cd5fbfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84527f16-b70f-419c-8c88-0f77cd5fbfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110ed091-7608-4209-8975-fcf2befda5b2', 'volume_name': 'volume-110ed091-7608-4209-8975-fcf2befda5b2', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c12896-8361-43c9-82cb-4af873d6a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c12896-8361-43c9-82cb-4af873d6a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c957c015-055d-4d62-8010-a662c77d8182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Volume 110ed091-7608-4209-8975-fcf2befda5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110ed091-7608-4209-8975-fcf2befda5b2', 'volume_size': 1}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:28 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 1073741824" returned: 0 in 1.119s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:28 devstack sudo[92831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1
Apr 29 08:46:28 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (90616262-8ced-4155-9796-c8d6221e1005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa052a8-723b-4359-9f31-99dbd2ab99a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa052a8-723b-4359-9f31-99dbd2ab99a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-236887254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de45da6-4a7f-4ff4-8f2f-08a2278c3513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:29Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53caddaf-b830-464a-a0c5-7886357a6c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:28 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53caddaf-b830-464a-a0c5-7886357a6c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b2b854-f736-41ee-8767-714acba26ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b2b854-f736-41ee-8767-714acba26ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de45da6-4a7f-4ff4-8f2f-08a2278c3513', 'volume_name': 'volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03624587-7c0d-40df-baa4-78f926f88610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03624587-7c0d-40df-baa4-78f926f88610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5097b10e-b0f0-4728-8c22-f2f02d1914e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:29 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Volume 6de45da6-4a7f-4ff4-8f2f-08a2278c3513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513', 'volume_size': 1}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:29 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1" returned: 0 in 0.860s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159953522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172a7fe5-d3e7-42a2-b43f-5c692bcb5144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:27Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Creating volume 172a7fe5-d3e7-42a2-b43f-5c692bcb5144 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:29 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:29 devstack sudo[92834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 1073741824
Apr 29 08:46:29 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (96023e0a-4875-4e9e-bfc1-3de2bc655a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8a52f4-369a-4715-b1b4-4261dcdc74d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7efe6c-77d6-4cbc-b6a6-a7e603c1e84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e46f205-b73d-46b2-bfa5-bda6ee7082fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8a52f4-369a-4715-b1b4-4261dcdc74d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1083457424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:29Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030db2a1-a858-4970-bab2-b71e205e42a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030db2a1-a858-4970-bab2-b71e205e42a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0beb8e7-9198-4420-b9ae-f74b6bb0fdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0beb8e7-9198-4420-b9ae-f74b6bb0fdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf', 'volume_name': 'volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f801ad20-be4a-4d1e-9b9a-d6ec5b8d2e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f801ad20-be4a-4d1e-9b9a-d6ec5b8d2e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e46d08-9f5e-476d-ba3f-f92b55145ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:29 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Volume eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf', 'volume_size': 1}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:29 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Volume volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 (fe5ae678-ff8e-451c-960d-1f08cbb323b1): created successfully
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e46f205-b73d-46b2-bfa5-bda6ee7082fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Flow 'volume_create_manager' (201b464b-b9b5-46ad-8e1f-7928fbd920f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:29 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ab7404ad-a3ee-4a71-9743-e9f6ec3499d0 tempest-VolumeDependencyTests-582183731 None] Created volume successfully.
Apr 29 08:46:29 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (5db73f48-4de1-4add-a59c-e5b38664d6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b54aa5-2f7c-4c4b-81ad-a6aeb4f384f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b54aa5-2f7c-4c4b-81ad-a6aeb4f384f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2039182073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7285e09-6725-4817-97e7-74abea4431fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:30Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc34e3dd-75ec-42f1-95e3-ef15ccd6a9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc34e3dd-75ec-42f1-95e3-ef15ccd6a9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f221205-6c84-4842-b8e2-58407bb99346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f221205-6c84-4842-b8e2-58407bb99346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7285e09-6725-4817-97e7-74abea4431fd', 'volume_name': 'volume-e7285e09-6725-4817-97e7-74abea4431fd', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd60db86-b6a2-4d11-8108-ede1aca0e74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd60db86-b6a2-4d11-8108-ede1aca0e74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f9e2f2-6a88-4565-8e78-e95b683f43e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:30 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Volume e7285e09-6725-4817-97e7-74abea4431fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7285e09-6725-4817-97e7-74abea4431fd', 'volume_size': 1}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:30 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 1073741824" returned: 0 in 0.942s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:30 devstack sudo[92840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144
Apr 29 08:46:30 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:30 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:31 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" returned: 0 in 0.721s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.166s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-274055204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874181b3-8be2-4eb3-8c4c-8f06c83258e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:28Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Creating volume 874181b3-8be2-4eb3-8c4c-8f06c83258e0 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:31 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041ab2a0-8dd9-4e88-9c06-9f6f22409274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7278f66a-34b4-423b-89d5-f366d094d6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:31 devstack sudo[92843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0 1073741824
Apr 29 08:46:31 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:31 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 (172a7fe5-d3e7-42a2-b43f-5c692bcb5144): created successfully
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7278f66a-34b4-423b-89d5-f366d094d6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:31 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (c5416094-9f21-49fe-a48d-e4e434808d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:31 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-32b4b04f-d0ed-4c49-ad3a-493792d6ae91 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created volume successfully.
Apr 29 08:46:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:32 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0 1073741824" returned: 0 in 0.928s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:32 devstack sudo[92855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0
Apr 29 08:46:32 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:33 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0" returned: 0 in 0.786s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.404s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-781592773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110ed091-7608-4209-8975-fcf2befda5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:28Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Creating volume 110ed091-7608-4209-8975-fcf2befda5b2 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:33 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:33 devstack sudo[92858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2 1073741824
Apr 29 08:46:33 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c85dc24-476d-4a29-9e42-7013291a1fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06d5ca0-9134-4d2f-abd9-586c278ae342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:33 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Volume volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0 (874181b3-8be2-4eb3-8c4c-8f06c83258e0): created successfully
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06d5ca0-9134-4d2f-abd9-586c278ae342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (243e24cd-b1d7-4b6d-8515-912ab7184dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:33 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ffec4e7d-3bd4-4be4-af8e-6c7f3b06ed3b tempest-CreateVolumesFromImageTest-854402967 None] Created volume successfully.
Apr 29 08:46:33 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2 1073741824" returned: 0 in 0.885s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:34 devstack sudo[92864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2
Apr 29 08:46:34 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:34 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2" returned: 0 in 0.623s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.596s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-236887254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de45da6-4a7f-4ff4-8f2f-08a2278c3513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:29Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Creating volume 6de45da6-4a7f-4ff4-8f2f-08a2278c3513 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:34 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:34 devstack sudo[92867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513 1073741824
Apr 29 08:46:34 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c957c015-055d-4d62-8010-a662c77d8182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110ed091-7608-4209-8975-fcf2befda5b2', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286f4edf-33da-4d73-819b-61c5925d6402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:34 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Volume volume-110ed091-7608-4209-8975-fcf2befda5b2 (110ed091-7608-4209-8975-fcf2befda5b2): created successfully
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286f4edf-33da-4d73-819b-61c5925d6402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:34 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (624649bb-8a87-41b0-a63f-c3f2eb5133ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:34 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-57b2dcda-65a4-4a31-8f73-15c93da2b9d9 tempest-CreateVolumesFromImageTest-854402967 None] Created volume successfully.
Apr 29 08:46:35 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513 1073741824" returned: 0 in 0.905s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:35 devstack sudo[92873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513
Apr 29 08:46:35 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:36 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513" returned: 0 in 0.640s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.463s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1083457424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:29Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Creating volume eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:36 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5097b10e-b0f0-4728-8c22-f2f02d1914e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:36 devstack sudo[92876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf 1073741824
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18203d79-1c47-4dfb-aec8-ac0f0de2f18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:36 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:36 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Volume volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513 (6de45da6-4a7f-4ff4-8f2f-08a2278c3513): created successfully
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18203d79-1c47-4dfb-aec8-ac0f0de2f18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (90616262-8ced-4155-9796-c8d6221e1005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:36 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-aab300ec-9368-4a0f-864a-244e0b5eb287 tempest-CreateVolumesFromImageTest-854402967 None] Created volume successfully.
Apr 29 08:46:37 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf 1073741824" returned: 0 in 0.855s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:37 devstack sudo[92882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf
Apr 29 08:46:37 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:37 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf" returned: 0 in 0.583s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.634s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2039182073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7285e09-6725-4817-97e7-74abea4431fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b6c8864b784772b85f54c46f3e757e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:30Z,use_quota=True,user_id='237b079d09c7403e9c28218d288110a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Creating volume e7285e09-6725-4817-97e7-74abea4431fd {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:37 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:37 devstack sudo[92885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd 1073741824
Apr 29 08:46:37 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e46d08-9f5e-476d-ba3f-f92b55145ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478f37c0-ca18-4861-a269-77a656389377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:37 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Volume volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf (eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf): created successfully
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478f37c0-ca18-4861-a269-77a656389377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (96023e0a-4875-4e9e-bfc1-3de2bc655a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:37 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b8f1da11-369c-4a14-8836-dc2ff8c31ff1 tempest-CreateVolumesFromImageTest-854402967 None] Created volume successfully.
Apr 29 08:46:38 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd 1073741824" returned: 0 in 0.923s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:38 devstack sudo[92891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd
Apr 29 08:46:38 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:39 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd" returned: 0 in 0.625s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.388s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f9e2f2-6a88-4565-8e78-e95b683f43e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7285e09-6725-4817-97e7-74abea4431fd', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad70384-f462-400f-8191-a08fe2052446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Creating offline snapshot 45253685-f11f-4d76-b921-36e9b6f53bf5 of volume fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:46:39 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Volume volume-e7285e09-6725-4817-97e7-74abea4431fd (e7285e09-6725-4817-97e7-74abea4431fd): created successfully
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad70384-f462-400f-8191-a08fe2052446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Flow 'volume_create_manager' (5db73f48-4de1-4add-a59c-e5b38664d6d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dff4a6-82d9-413e-b3ea-cef23cd67b8a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:39 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-77bf36ce-68dc-4b59-8c75-b382c7ab0e53 tempest-CreateVolumesFromImageTest-854402967 None] Created volume successfully.
Apr 29 08:46:39 devstack sudo[92894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1
Apr 29 08:46:39 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-e7285e09-6725-4817-97e7-74abea4431fd-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-e7285e09-6725-4817-97e7-74abea4431fd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-quobyte-e7285e09-6725-4817-97e7-74abea4431fd" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-e7285e09-6725-4817-97e7-74abea4431fd" acquired by "delete_volume" :: waited 0.014s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:40 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8927db6-94bc-42e7-8d5a-3573641d0276]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:40 devstack sudo[92896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd
Apr 29 08:46:40 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:40 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1" returned: 0 in 0.814s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:40 devstack sudo[92902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 1G
Apr 29 08:46:40 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:40 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd" returned: 0 in 0.770s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:40 devstack sudo[92909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd
Apr 29 08:46:40 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:41 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 1G" returned: 0 in 0.870s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:41 devstack sudo[92913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5
Apr 29 08:46:41 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:41 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e7285e09-6725-4817-97e7-74abea4431fd" returned: 0 in 0.742s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-e7285e09-6725-4817-97e7-74abea4431fd" released by "delete_volume" :: held 1.556s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Created reservations ['419e3191-6a87-4f1e-bcd8-1c02a63368b6', '4cb87a2b-a7b8-47b4-8c9e-ec5ed28d88ff', '884b407f-e630-4ecd-9c24-a09b68f05819', 'a46de38d-f073-4f7c-bd92-49878be9a1a4'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:41 devstack sudo[92919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:46:41 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:41 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5" returned: 0 in 0.740s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:41 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 is being set with open permissions: ugo+rw
Apr 29 08:46:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:41 devstack sudo[92921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5
Apr 29 08:46:41 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-quobyte-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe11a14-5bba-4c32-8e85-74840f5dfdf7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:42 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.731s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Deleted volume successfully.
Apr 29 08:46:42 devstack sudo[92923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf
Apr 29 08:46:42 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-675be48d-fe00-4d9f-b800-07c103b96b9c tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-e7285e09-6725-4817-97e7-74abea4431fd-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:42 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5" returned: 0 in 0.668s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:42 devstack sudo[92927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.info
Apr 29 08:46:42 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:43 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.info" returned: 0 in 0.643s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:43 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.info is being set with open permissions: ugo+rw
Apr 29 08:46:43 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf" returned: 0 in 0.878s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:43 devstack sudo[92934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.info
Apr 29 08:46:43 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:43 devstack sudo[92935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf
Apr 29 08:46:43 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:43 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.info" returned: 0 in 0.632s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.536s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.732s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:43 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf" returned: 0 in 0.679s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Creating offline snapshot c8404eaa-b41b-4023-b712-d331f508a890 of volume 172a7fe5-d3e7-42a2-b43f-5c692bcb5144 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf" released by "delete_volume" :: held 1.643s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb7f6f6-621f-4eb9-92ce-d608a66c31d5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:43 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e0afbc16-91ad-493f-9554-77cedccab3df tempest-VolumeDependencyTests-582183731 None] Create snapshot completed successfully
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Created reservations ['6a6dd783-eec0-47e8-b0e5-c1dd30902de3', '986a70b4-af42-42b0-9a3b-7b8ca7768c47', '60b0c877-745a-4752-bcb6-19b73fd47a4a', 'bb4ad36d-cad1-46f4-a2f7-eb51537badcb'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:44 devstack sudo[92941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144
Apr 29 08:46:44 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:44 devstack sudo[92943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:46:44 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-6de45da6-4a7f-4ff4-8f2f-08a2278c3513-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-6de45da6-4a7f-4ff4-8f2f-08a2278c3513-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-quobyte-6de45da6-4a7f-4ff4-8f2f-08a2278c3513" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-6de45da6-4a7f-4ff4-8f2f-08a2278c3513" acquired by "delete_volume" :: waited 0.033s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24aacf4-0a70-4827-90da-bc9abe322245]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:44 devstack sudo[92948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513
Apr 29 08:46:44 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:44 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" returned: 0 in 0.988s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:44 devstack sudo[92950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 1G
Apr 29 08:46:44 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:45 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.069s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:45 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Deleted volume successfully.
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-81e1fb9a-0e5d-4160-9afc-5ffdd46be04d tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-eb36fcab-3afe-4cfd-ace4-ae1eff50fbaf-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Flow 'volume_create_manager' (afe14982-1cf7-4bca-a976-c3b088b990c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d2513f-f3ea-4cce-808c-1e4ce81236d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d2513f-f3ea-4cce-808c-1e4ce81236d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-648964554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9420d643-5038-421f-8e6d-5a97ee834441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c0195a81b74ea8903de4b453826710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45253685-f11f-4d76-b921-36e9b6f53bf5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:45Z,use_quota=True,user_id='ca72234a7e2242f7a1263c9acb9dcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9eef23-602d-42a7-92cf-3e85bb14c3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9eef23-602d-42a7-92cf-3e85bb14c3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a61535-7d08-4830-bd06-cef23bed9542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a61535-7d08-4830-bd06-cef23bed9542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9420d643-5038-421f-8e6d-5a97ee834441', 'volume_name': 'volume-9420d643-5038-421f-8e6d-5a97ee834441', 'volume_size': 1, 'snapshot_id': '45253685-f11f-4d76-b921-36e9b6f53bf5'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b1e1ce-1724-4e64-a4ce-dab3b5612635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b1e1ce-1724-4e64-a4ce-dab3b5612635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e77e795-a9c8-4426-b160-df61fad9677e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:45 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Volume 9420d643-5038-421f-8e6d-5a97ee834441: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9420d643-5038-421f-8e6d-5a97ee834441', 'volume_size': 1, 'snapshot_id': '45253685-f11f-4d76-b921-36e9b6f53bf5'}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:45 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513" returned: 0 in 0.952s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:45 devstack sudo[92960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513
Apr 29 08:46:45 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:45 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 1G" returned: 0 in 1.047s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:46 devstack sudo[92962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890
Apr 29 08:46:46 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:46 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-6de45da6-4a7f-4ff4-8f2f-08a2278c3513" returned: 0 in 0.695s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-6de45da6-4a7f-4ff4-8f2f-08a2278c3513" released by "delete_volume" :: held 1.712s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Created reservations ['5adccf61-b619-4110-b398-358dd6a29e40', '9e902595-fd6e-4083-8861-0f352bf943c4', 'e056c4e0-fc8b-4014-b32d-cfe2e374accd', '6d3bb3a4-1740-492d-b7c9-fe6c6edd38c5'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:46 devstack sudo[92967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:46:46 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:46 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890" returned: 0 in 0.761s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:46 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 is being set with open permissions: ugo+rw
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:46 devstack sudo[92971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890
Apr 29 08:46:46 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-110ed091-7608-4209-8975-fcf2befda5b2-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-110ed091-7608-4209-8975-fcf2befda5b2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-quobyte-110ed091-7608-4209-8975-fcf2befda5b2" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-110ed091-7608-4209-8975-fcf2befda5b2" acquired by "delete_volume" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:47 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[03048ba0-3530-4aa9-a16c-6de17e378341]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:47 devstack sudo[92973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2
Apr 29 08:46:47 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:47 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.819s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:47 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:47 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Deleted volume successfully.
Apr 29 08:46:47 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-a1d1850b-b819-41b3-9886-fb3888c86416 tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-6de45da6-4a7f-4ff4-8f2f-08a2278c3513-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:47 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890" returned: 0 in 0.931s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:47 devstack sudo[92977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.info
Apr 29 08:46:47 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:48 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2" returned: 0 in 1.091s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:48 devstack sudo[92983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2
Apr 29 08:46:48 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:48 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.info" returned: 0 in 0.712s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:48 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.info is being set with open permissions: ugo+rw
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:48 devstack sudo[92986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.info
Apr 29 08:46:48 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:48 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-110ed091-7608-4209-8975-fcf2befda5b2" returned: 0 in 0.657s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-110ed091-7608-4209-8975-fcf2befda5b2" released by "delete_volume" :: held 1.811s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Created reservations ['6617a905-741c-421f-860b-a6d6088be8f1', '450fe2a1-0a71-4d66-b036-cfd77224a122', '40b29ac8-26ff-4b8e-a593-3885a4e6a913', '316855a7-184c-4caf-8730-95ac061549e0'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:48 devstack sudo[92989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:46:48 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:49 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.info" returned: 0 in 0.662s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.266s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.595s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-45253685-f11f-4d76-b921-36e9b6f53bf5-9420d643-5038-421f-8e6d-5a97ee834441" by "_create_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:49 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-1cac2b7e-9a25-4366-bc93-a6635282c835 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Create snapshot completed successfully
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-45253685-f11f-4d76-b921-36e9b6f53bf5-9420d643-5038-421f-8e6d-5a97ee834441" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Creating volume 9420d643-5038-421f-8e6d-5a97ee834441 from snapshot 45253685-f11f-4d76-b921-36e9b6f53bf5 {{(pid=83885) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-9420d643-5038-421f-8e6d-5a97ee834441" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-874181b3-8be2-4eb3-8c4c-8f06c83258e0-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-9420d643-5038-421f-8e6d-5a97ee834441" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] snapshot: 45253685-f11f-4d76-b921-36e9b6f53bf5, volume: 9420d643-5038-421f-8e6d-5a97ee834441,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-874181b3-8be2-4eb3-8c4c-8f06c83258e0-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c25a84a-fa60-4786-a767-3611e8cdc37d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "cinder-quobyte-874181b3-8be2-4eb3-8c4c-8f06c83258e0" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-874181b3-8be2-4eb3-8c4c-8f06c83258e0" acquired by "delete_volume" :: waited 0.036s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:49 devstack sudo[92992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5
Apr 29 08:46:49 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[7765329b-23a0-48ad-ba0e-aa49f0ed0e9f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:49 devstack sudo[92994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0
Apr 29 08:46:49 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:49 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.806s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:49 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Deleted volume successfully.
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-43c9d963-ed91-4dc1-bf77-c76099d32692 tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-110ed091-7608-4209-8975-fcf2befda5b2-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:49 devstack sudo[92997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:46:49 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:50 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5" returned: 0 in 1.045s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a170425-566c-4169-a6e1-9b2a88a60a6a]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:50 devstack sudo[93002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1
Apr 29 08:46:50 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:50 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.968s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (0b3137f4-79cc-4a46-b7a6-4ef72e6d28b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1209355d-0bfc-4ec9-849a-639f7813f449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:50 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1209355d-0bfc-4ec9-849a-639f7813f449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1117339902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fe7f52-b81f-4c38-aa9f-5fd328404d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:51Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b588616-729a-4ec2-a4f5-d8afefdeb604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b588616-729a-4ec2-a4f5-d8afefdeb604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b887a6-c8b1-4351-9954-499eb9f97df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b887a6-c8b1-4351-9954-499eb9f97df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fe7f52-b81f-4c38-aa9f-5fd328404d5e', 'volume_name': 'volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ea0649-0a84-46ac-82a2-ee93ef6e31f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ea0649-0a84-46ac-82a2-ee93ef6e31f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18533ad-7cb1-46e8-a7ea-cc30aa522c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:50 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume c2fe7f52-b81f-4c38-aa9f-5fd328404d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e', 'volume_size': 1}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0" returned: 0 in 1.533s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:51 devstack sudo[93008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0
Apr 29 08:46:51 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (0fcce92f-823d-4812-aa6d-033fbc1396d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e477cbe2-b5f8-4aaa-8741-df27633f0e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e477cbe2-b5f8-4aaa-8741-df27633f0e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-426359726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97e561a-deb2-421a-bdd2-9519b8ea5247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:51Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eeb4a3a-9af4-4780-9225-5ae42a03cf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eeb4a3a-9af4-4780-9225-5ae42a03cf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60108358-c412-4122-a1cf-040a48fd329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60108358-c412-4122-a1cf-040a48fd329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97e561a-deb2-421a-bdd2-9519b8ea5247', 'volume_name': 'volume-b97e561a-deb2-421a-bdd2-9519b8ea5247', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c22dc02-dab2-44d1-bf0b-e2c2dcbbc2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c22dc02-dab2-44d1-bf0b-e2c2dcbbc2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ebe4c2-1672-4d95-b6f6-e74bb88b8106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume b97e561a-deb2-421a-bdd2-9519b8ea5247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97e561a-deb2-421a-bdd2-9519b8ea5247', 'volume_size': 1}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:51 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-874181b3-8be2-4eb3-8c4c-8f06c83258e0" returned: 0 in 0.749s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-quobyte-874181b3-8be2-4eb3-8c4c-8f06c83258e0" released by "delete_volume" :: held 2.360s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Created reservations ['ca69e2b7-ea56-4741-850f-b344a0ed74ac', '66abf6a6-4b84-4a9d-9901-64f946bf215b', '136a7b7f-6b30-40aa-b7cd-d415fd81d71a', '770272ab-ab14-429f-8999-b7c545e9cdd6'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (6731beae-fa83-43ab-af36-943c46fdd7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06b12cc-1b35-4977-8305-7ac51a36e7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1" returned: 0 in 1.530s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441 not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06b12cc-1b35-4977-8305-7ac51a36e7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1419601181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b4dc9b-fd67-4bb0-83e1-070da1b17743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:52Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:51 devstack sudo[93014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441
Apr 29 08:46:51 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ecbc3a-2718-4694-babe-d4b0212b97aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ecbc3a-2718-4694-babe-d4b0212b97aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65a784f-7ed2-49f8-95c2-7db637384835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65a784f-7ed2-49f8-95c2-7db637384835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b4dc9b-fd67-4bb0-83e1-070da1b17743', 'volume_name': 'volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b06de94-c7a1-46da-9485-c5e8011bd7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b06de94-c7a1-46da-9485-c5e8011bd7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4cc548-7857-43c2-9540-0443a36151f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:51 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume d6b4dc9b-fd67-4bb0-83e1-070da1b17743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743', 'volume_size': 1}
Apr 29 08:46:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:52 devstack sudo[93016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:46:52 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (b790f960-bce0-4520-a34a-d8ef3b121b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8d9772-d6d1-4c83-ab11-5fdebb88fd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8d9772-d6d1-4c83-ab11-5fdebb88fd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7225153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f0cfe5-2523-4580-8cba-f1d10f9a92e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:52Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487438cc-d2df-45ef-8432-2ef3c0814106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487438cc-d2df-45ef-8432-2ef3c0814106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d6ff0a-8f1c-49ab-825c-7538cec187d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d6ff0a-8f1c-49ab-825c-7538cec187d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f0cfe5-2523-4580-8cba-f1d10f9a92e4', 'volume_name': 'volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8656534c-d6af-4e47-9ce0-8aea2f62e4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8656534c-d6af-4e47-9ce0-8aea2f62e4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c2b7b1-1ac1-4ac7-8382-1ef432054115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume 32f0cfe5-2523-4580-8cba-f1d10f9a92e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4', 'volume_size': 1}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Flow 'volume_create_manager' (206e7293-0d28-46b3-a0da-07f4aa6618c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68de216a-2170-483c-a68c-f2bab8b975dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68de216a-2170-483c-a68c-f2bab8b975dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-585999570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b2b403-28ed-4c3f-baf8-4aac854a5c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c793503e3bbb45ab996590aba632c5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:53Z,use_quota=True,user_id='3eb167d416db405ab994ecb058df6318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac075f9e-c6d6-4921-a8fc-09a5bc14716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac075f9e-c6d6-4921-a8fc-09a5bc14716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:52 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833d877e-e0ae-4195-933d-0c44f30165cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833d877e-e0ae-4195-933d-0c44f30165cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b2b403-28ed-4c3f-baf8-4aac854a5c9a', 'volume_name': 'volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4c605b-0a26-4ce7-a0fe-ff2896984ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4c605b-0a26-4ce7-a0fe-ff2896984ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e8c1c6-c412-4bdc-a71f-2ef81bcc698b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:52 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Volume 05b2b403-28ed-4c3f-baf8-4aac854a5c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a', 'volume_size': 1}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.875s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:52 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Deleted volume successfully.
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (61c73182-9832-4eda-b4b7-12498cbb14e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:52 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ebdec2-b866-49a2-9b4a-20dcde354485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ebdec2-b866-49a2-9b4a-20dcde354485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410116414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e165d86b-7fdd-45df-b43f-01ac0510c8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:53Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee09cd3-3d4f-450b-aaf2-52e84b3751e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee09cd3-3d4f-450b-aaf2-52e84b3751e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d51491-27de-4efd-856b-9fffdc380989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d51491-27de-4efd-856b-9fffdc380989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e165d86b-7fdd-45df-b43f-01ac0510c8bb', 'volume_name': 'volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a82cf4-b0f4-4835-b14d-df3ea6974cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a82cf4-b0f4-4835-b14d-df3ea6974cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d530840e-b7d0-4ab2-99f9-b951287f3e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:53 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume e165d86b-7fdd-45df-b43f-01ac0510c8bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb', 'volume_size': 1}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b87e9308-4f4c-4ede-831d-a65d7f6ace7a tempest-CreateVolumesFromImageTest-854402967 None] Lock "cinder-874181b3-8be2-4eb3-8c4c-8f06c83258e0-delete_volume" released by "delete_volume" :: held 3.789s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:57 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441" returned: 0 in 5.879s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:57 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c93fd7a-2214-463b-b85d-d7efae8d3734]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:57 devstack sudo[93031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1
Apr 29 08:46:57 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (d9537bb8-1ec9-420a-812a-8659c4f23199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ba71e5-f352-48c9-9577-619121db5d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ba71e5-f352-48c9-9577-619121db5d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-251148863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767375a1-0ca3-4eb8-83e4-a0e468a8e8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:58Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb04d80-2b8a-40fd-8d91-1c69c952e4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb04d80-2b8a-40fd-8d91-1c69c952e4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844ce414-d5b1-49ab-86ab-3ee55dbc038c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844ce414-d5b1-49ab-86ab-3ee55dbc038c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767375a1-0ca3-4eb8-83e4-a0e468a8e8e7', 'volume_name': 'volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebbc8f9-e079-47d6-aecd-ee9951659f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebbc8f9-e079-47d6-aecd-ee9951659f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0886a21a-fae7-48e5-86b1-a934d7f5fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:58 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume 767375a1-0ca3-4eb8-83e4-a0e468a8e8e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7', 'volume_size': 1}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:58 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1" returned: 0 in 0.879s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:46:58 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Converted 1024.00 MB image at 174.13 MB/s
Apr 29 08:46:58 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441 is being set with open permissions: ugo+rw
Apr 29 08:46:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:58 devstack sudo[93036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441
Apr 29 08:46:58 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:59 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441" returned: 0 in 0.574s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-9420d643-5038-421f-8e6d-5a97ee834441" released by "_copy_volume_from_snapshot" :: held 10.049s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-45253685-f11f-4d76-b921-36e9b6f53bf5-9420d643-5038-421f-8e6d-5a97ee834441" released by "_create_volume_from_snapshot" :: held 10.098s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.131s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.296s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1117339902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fe7f52-b81f-4c38-aa9f-5fd328404d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:51Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Creating volume c2fe7f52-b81f-4c38-aa9f-5fd328404d5e {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:59 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:59 devstack sudo[93039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e 1073741824
Apr 29 08:46:59 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e77e795-a9c8-4426-b160-df61fad9677e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9420d643-5038-421f-8e6d-5a97ee834441', 'volume_size': 1, 'snapshot_id': '45253685-f11f-4d76-b921-36e9b6f53bf5'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb9ad9b-86a9-48bd-ac07-36a6decb0ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:59 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Volume volume-9420d643-5038-421f-8e6d-5a97ee834441 (9420d643-5038-421f-8e6d-5a97ee834441): created successfully
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb9ad9b-86a9-48bd-ac07-36a6decb0ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:59 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Flow 'volume_create_manager' (afe14982-1cf7-4bca-a976-c3b088b990c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:59 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-c0f8be82-dd40-400d-b4ed-5b34682776e9 tempest-VolumeDependencyTests-582183731 None] Created volume successfully.
Apr 29 08:47:00 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e 1073741824" returned: 0 in 0.731s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:00 devstack sudo[93044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e
Apr 29 08:47:00 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-45253685-f11f-4d76-b921-36e9b6f53bf5-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-45253685-f11f-4d76-b921-36e9b6f53bf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-fe5ae678-ff8e-451c-960d-1f08cbb323b1" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-fe5ae678-ff8e-451c-960d-1f08cbb323b1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-45253685-f11f-4d76-b921-36e9b6f53bf5" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-45253685-f11f-4d76-b921-36e9b6f53bf5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Deleting offline snapshot 45253685-f11f-4d76-b921-36e9b6f53bf5 of volume fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] snapshot_file for this snap is: volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a48e83-bca8-41b8-9a27-f9aad1aea780]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:00 devstack sudo[93046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5
Apr 29 08:47:00 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:00 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e" returned: 0 in 0.669s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.187s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-426359726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97e561a-deb2-421a-bdd2-9519b8ea5247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:51Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Creating volume b97e561a-deb2-421a-bdd2-9519b8ea5247 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:00 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:00 devstack sudo[93049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247 1073741824
Apr 29 08:47:00 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18533ad-7cb1-46e8-a7ea-cc30aa522c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bf7ea0-8cd0-4a36-9e1b-cde3d28d136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:00 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e (c2fe7f52-b81f-4c38-aa9f-5fd328404d5e): created successfully
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81bf7ea0-8cd0-4a36-9e1b-cde3d28d136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:00 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (0b3137f4-79cc-4a46-b7a6-4ef72e6d28b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:00 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d60af792-b5d0-4015-a80e-6db12cdf9c5c tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created volume successfully.
Apr 29 08:47:01 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5" returned: 0 in 0.739s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:01 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:47:01 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f793b80d-6ef6-458e-9a83-21325d1febb6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:01 devstack sudo[93054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1
Apr 29 08:47:01 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:01 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247 1073741824" returned: 0 in 0.831s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:01 devstack sudo[93060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247
Apr 29 08:47:01 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:01 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1" returned: 0 in 0.754s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:02 devstack sudo[93065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5
Apr 29 08:47:02 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:02 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247" returned: 0 in 0.620s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.249s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1419601181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b4dc9b-fd67-4bb0-83e1-070da1b17743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:52Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Creating volume d6b4dc9b-fd67-4bb0-83e1-070da1b17743 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:02 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ebe4c2-1672-4d95-b6f6-e74bb88b8106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97e561a-deb2-421a-bdd2-9519b8ea5247', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:02 devstack sudo[93068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743 1073741824
Apr 29 08:47:02 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b66dc27-8f18-4283-b08e-6fb42e7eb292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:02 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume volume-b97e561a-deb2-421a-bdd2-9519b8ea5247 (b97e561a-deb2-421a-bdd2-9519b8ea5247): created successfully
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b66dc27-8f18-4283-b08e-6fb42e7eb292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (0fcce92f-823d-4812-aa6d-033fbc1396d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6188c2e3-366a-474b-adeb-6887e34961f5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created volume successfully.
Apr 29 08:47:02 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5" returned: 0 in 0.701s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:02 devstack sudo[93073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5
Apr 29 08:47:02 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:03 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743 1073741824" returned: 0 in 0.794s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:03 devstack sudo[93079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743
Apr 29 08:47:03 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:03 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1.45253685-f11f-4d76-b921-36e9b6f53bf5" returned: 0 in 0.606s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-45253685-f11f-4d76-b921-36e9b6f53bf5" released by "_delete_snapshot" :: held 2.902s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-fe5ae678-ff8e-451c-960d-1f08cbb323b1" released by "delete_snapshot" :: held 2.925s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Created reservations ['167244df-774d-4325-bc2d-25f94a16adc3', '2cf00760-ffe3-4940-8b77-3433b9771580', '66d93e0a-e9e4-4b59-89a7-2afbe3251f61', '2af6e8c1-8d73-4905-a0d4-2b35a0043eda'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:03 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Delete snapshot completed successfully.
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-50292a65-6096-44d1-9f20-ba2d84543525 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-45253685-f11f-4d76-b921-36e9b6f53bf5-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-fe5ae678-ff8e-451c-960d-1f08cbb323b1-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-fe5ae678-ff8e-451c-960d-1f08cbb323b1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-fe5ae678-ff8e-451c-960d-1f08cbb323b1" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-fe5ae678-ff8e-451c-960d-1f08cbb323b1" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a972c8-b11d-47ea-804e-05924ed4e458]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:03 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743" returned: 0 in 0.669s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.018s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7225153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f0cfe5-2523-4580-8cba-f1d10f9a92e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:52Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Creating volume 32f0cfe5-2523-4580-8cba-f1d10f9a92e4 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:03 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:03 devstack sudo[93085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4 1073741824
Apr 29 08:47:03 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4cc548-7857-43c2-9540-0443a36151f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37cf700-b68e-4652-9ba4-729812410980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:03 devstack sudo[93084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1
Apr 29 08:47:03 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:03 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743 (d6b4dc9b-fd67-4bb0-83e1-070da1b17743): created successfully
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37cf700-b68e-4652-9ba4-729812410980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:03 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (6731beae-fa83-43ab-af36-943c46fdd7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:03 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-9ec7e620-a7c0-4b1a-b463-004fa24bf96d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created volume successfully.
Apr 29 08:47:04 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1" returned: 0 in 0.722s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:04 devstack sudo[93094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1
Apr 29 08:47:04 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:04 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4 1073741824" returned: 0 in 0.853s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:04 devstack sudo[93096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4
Apr 29 08:47:04 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:05 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-fe5ae678-ff8e-451c-960d-1f08cbb323b1" returned: 0 in 0.590s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-fe5ae678-ff8e-451c-960d-1f08cbb323b1" released by "delete_volume" :: held 1.397s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Created reservations ['d0b96e07-cf8c-4e06-bed0-bb22787992a4', 'f07dc187-793e-4b9f-a9cc-0df7aa4d3a71', '5b9335ff-624c-4024-b1b2-9da2ec6cf508', 'dabcf2e7-ac0a-4734-859d-37d4d0f6975b'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:05 devstack sudo[93099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:05 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:05 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4" returned: 0 in 0.642s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.380s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-585999570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b2b403-28ed-4c3f-baf8-4aac854a5c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c793503e3bbb45ab996590aba632c5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:53Z,use_quota=True,user_id='3eb167d416db405ab994ecb058df6318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Creating volume 05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:05 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c2b7b1-1ac1-4ac7-8382-1ef432054115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:05 devstack sudo[93102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a 1073741824
Apr 29 08:47:05 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e74bff-25e8-4564-b64b-52458d4d4b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:05 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4 (32f0cfe5-2523-4580-8cba-f1d10f9a92e4): created successfully
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e74bff-25e8-4564-b64b-52458d4d4b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (b790f960-bce0-4520-a34a-d8ef3b121b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:05 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-21c3ccf4-7583-4059-993f-1eae8bc875a7 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created volume successfully.
Apr 29 08:47:05 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.627s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:05 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Deleted volume successfully.
Apr 29 08:47:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4940ebb9-c0b6-420f-9d6b-60227c776559 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-fe5ae678-ff8e-451c-960d-1f08cbb323b1-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:06 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a 1073741824" returned: 0 in 0.905s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:06 devstack sudo[93109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a
Apr 29 08:47:06 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Flow 'volume_create_manager' (dba08d52-4de8-47a5-900c-58926694f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21d711d-f88c-4245-9260-d5d1c5c02c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21d711d-f88c-4245-9260-d5d1c5c02c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-613966514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33734b74-09ed-454a-99ee-fed604d3d356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c0195a81b74ea8903de4b453826710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:06Z,use_quota=True,user_id='ca72234a7e2242f7a1263c9acb9dcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668362d8-1908-44ab-9da7-1b851666fea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668362d8-1908-44ab-9da7-1b851666fea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60496419-760c-4a3f-93be-8d40bc71d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60496419-760c-4a3f-93be-8d40bc71d049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33734b74-09ed-454a-99ee-fed604d3d356', 'volume_name': 'volume-33734b74-09ed-454a-99ee-fed604d3d356', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90e74cf-6b34-4ae4-a78f-cbfe2ab4302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90e74cf-6b34-4ae4-a78f-cbfe2ab4302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379a4877-d92c-44d5-8a29-9bedc3a9b23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:06 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Volume 33734b74-09ed-454a-99ee-fed604d3d356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33734b74-09ed-454a-99ee-fed604d3d356', 'volume_size': 1}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:06 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" returned: 0 in 0.604s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.811s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410116414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e165d86b-7fdd-45df-b43f-01ac0510c8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b16790480c40f7a61206e01a71e763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:53Z,use_quota=True,user_id='fcf73636c5184ddeb25d4569aab8699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Creating volume e165d86b-7fdd-45df-b43f-01ac0510c8bb {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:06 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e8c1c6-c412-4bdc-a71f-2ef81bcc698b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:06 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb 1073741824
Apr 29 08:47:06 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123957e9-e78e-41e1-9ebb-e1b852b052e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:06 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Volume volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a (05b2b403-28ed-4c3f-baf8-4aac854a5c9a): created successfully
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123957e9-e78e-41e1-9ebb-e1b852b052e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:06 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Flow 'volume_create_manager' (206e7293-0d28-46b3-a0da-07f4aa6618c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-724b47a2-3cca-4317-a19b-2c6bd72c5811 tempest-SnapshotDependencyTests-1176354595 None] Created volume successfully.
Apr 29 08:47:07 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb 1073741824" returned: 0 in 0.784s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:07 devstack sudo[93118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb
Apr 29 08:47:07 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:08 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb" returned: 0 in 0.649s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.058s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-251148863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767375a1-0ca3-4eb8-83e4-a0e468a8e8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:58Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Creating volume 767375a1-0ca3-4eb8-83e4-a0e468a8e8e7 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:08 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:08 devstack sudo[93121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7 1073741824
Apr 29 08:47:08 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d530840e-b7d0-4ab2-99f9-b951287f3e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59fcf80-cefb-43ff-a7a7-756cc2903025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:08 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Volume volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb (e165d86b-7fdd-45df-b43f-01ac0510c8bb): created successfully
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59fcf80-cefb-43ff-a7a7-756cc2903025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:08 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Flow 'volume_create_manager' (61c73182-9832-4eda-b4b7-12498cbb14e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:08 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-996e0d20-b02e-4a7a-b536-a2df708c8ab8 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created volume successfully.
Apr 29 08:47:09 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7 1073741824" returned: 0 in 0.785s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:09 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7
Apr 29 08:47:09 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-e165d86b-7fdd-45df-b43f-01ac0510c8bb-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-e165d86b-7fdd-45df-b43f-01ac0510c8bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-quobyte-e165d86b-7fdd-45df-b43f-01ac0510c8bb" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-e165d86b-7fdd-45df-b43f-01ac0510c8bb" acquired by "delete_volume" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b8d156-a86c-40bc-8b3f-2d4b7cdadf60]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:09 devstack sudo[93128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb
Apr 29 08:47:09 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:09 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7" returned: 0 in 0.672s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.478s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-613966514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33734b74-09ed-454a-99ee-fed604d3d356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c0195a81b74ea8903de4b453826710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:06Z,use_quota=True,user_id='ca72234a7e2242f7a1263c9acb9dcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Creating volume 33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:09 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0886a21a-fae7-48e5-86b1-a934d7f5fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:09 devstack sudo[93131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 1073741824
Apr 29 08:47:09 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aa9d14-1240-4b82-8cd6-a7328c42b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:09 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7 (767375a1-0ca3-4eb8-83e4-a0e468a8e8e7): created successfully
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aa9d14-1240-4b82-8cd6-a7328c42b026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:09 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (d9537bb8-1ec9-420a-812a-8659c4f23199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:09 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-9ffc08b1-f717-44a1-b4f3-74d743bbafde tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created volume successfully.
Apr 29 08:47:10 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb" returned: 0 in 0.798s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:10 devstack sudo[93137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb
Apr 29 08:47:10 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:10 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 1073741824" returned: 0 in 0.825s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:10 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:10 devstack sudo[93142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356
Apr 29 08:47:10 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:11 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-e165d86b-7fdd-45df-b43f-01ac0510c8bb" returned: 0 in 0.641s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-e165d86b-7fdd-45df-b43f-01ac0510c8bb" released by "delete_volume" :: held 1.479s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created reservations ['6e3722fb-3808-4b30-97b8-a1ac059164d0', 'df513274-c563-4a3e-8cf1-9277ec396df8', 'c8d7c3c4-c1ae-42f9-9970-7080a83c7fc8', 'ee2efea9-c7b3-4c0e-83ae-7bebe073dbd8'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:11 devstack sudo[93146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:11 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:11 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356" returned: 0 in 0.624s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.285s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379a4877-d92c-44d5-8a29-9bedc3a9b23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33734b74-09ed-454a-99ee-fed604d3d356', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4d5cce-79b0-4465-acb1-1a8d942e57b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Creating offline snapshot 313da2f2-c4cd-40c0-a872-ba7d1bc528c8 of volume 05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:47:11 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Volume volume-33734b74-09ed-454a-99ee-fed604d3d356 (33734b74-09ed-454a-99ee-fed604d3d356): created successfully
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4d5cce-79b0-4465-acb1-1a8d942e57b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Flow 'volume_create_manager' (dba08d52-4de8-47a5-900c-58926694f000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3650ba-bc26-4904-976d-ffd203ec3bb8]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:11 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6bac6447-320d-4ceb-ab03-162bc79d9996 tempest-VolumeDependencyTests-582183731 None] Created volume successfully.
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:11 devstack sudo[93148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a
Apr 29 08:47:11 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (90cf18d4-cfd5-46d6-87ee-8e2d339d43db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafa7e1f-e6f1-475e-a7ab-606a36802ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafa7e1f-e6f1-475e-a7ab-606a36802ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117895271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c04ec5b-74e2-4f1c-8974-e6919fdeba7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:12Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a51961-905d-44ed-8ba3-ce24844bb2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a51961-905d-44ed-8ba3-ce24844bb2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4601c086-96db-43b5-902a-7fcb92d35411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4601c086-96db-43b5-902a-7fcb92d35411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c04ec5b-74e2-4f1c-8974-e6919fdeba7e', 'volume_name': 'volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3c6e2e-1d3f-4ffb-b529-4aa96298d877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3c6e2e-1d3f-4ffb-b529-4aa96298d877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dba255-c32e-418f-ad65-670b7d863f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:11 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume 2c04ec5b-74e2-4f1c-8974-e6919fdeba7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e', 'volume_size': 1}
Apr 29 08:47:11 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (c56d06cb-c87d-425d-bdb7-f18a5b0d8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0df3b1-7c28-4ce0-a207-38fef74363df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0df3b1-7c28-4ce0-a207-38fef74363df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1388003869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632132c4-a2ed-4bad-bc07-1413e3a01892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:12Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba2d297-5fff-4fda-b2ee-8d4f7797e9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba2d297-5fff-4fda-b2ee-8d4f7797e9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca427ce9-5900-41e3-9927-3a80fb0c1fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca427ce9-5900-41e3-9927-3a80fb0c1fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632132c4-a2ed-4bad-bc07-1413e3a01892', 'volume_name': 'volume-632132c4-a2ed-4bad-bc07-1413e3a01892', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23db4e26-6c4e-41ea-bcac-9a6f8e56c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23db4e26-6c4e-41ea-bcac-9a6f8e56c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bb5a16-2c11-4086-878f-b363262984af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume 632132c4-a2ed-4bad-bc07-1413e3a01892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632132c4-a2ed-4bad-bc07-1413e3a01892', 'volume_size': 1}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:12 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.976s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:12 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Deleted volume successfully.
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-de63b0de-b55b-4c06-87e1-843415cac395 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-e165d86b-7fdd-45df-b43f-01ac0510c8bb-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-32f0cfe5-2523-4580-8cba-f1d10f9a92e4-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-32f0cfe5-2523-4580-8cba-f1d10f9a92e4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Flow 'volume_create_manager' (208d88d5-c3df-4d79-a77a-07854954ff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed51bd9-be08-4484-9eeb-5596b4f04982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-quobyte-32f0cfe5-2523-4580-8cba-f1d10f9a92e4" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-32f0cfe5-2523-4580-8cba-f1d10f9a92e4" acquired by "delete_volume" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed51bd9-be08-4484-9eeb-5596b4f04982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1267591365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ae8519-b58c-42c7-bf86-abd634e31787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46c0195a81b74ea8903de4b453826710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=33734b74-09ed-454a-99ee-fed604d3d356,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:12Z,use_quota=True,user_id='ca72234a7e2242f7a1263c9acb9dcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc66a22-c8d6-4dd4-b056-45790846780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc66a22-c8d6-4dd4-b056-45790846780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b117d1-fe83-4e9e-9b7d-18b104d8a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b9443-12e4-4c33-9d9b-77591be16fe6]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" returned: 0 in 1.157s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:12 devstack sudo[93156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 1G
Apr 29 08:47:12 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b117d1-fe83-4e9e-9b7d-18b104d8a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c3ae8519-b58c-42c7-bf86-abd634e31787', 'volume_name': 'volume-c3ae8519-b58c-42c7-bf86-abd634e31787', 'volume_size': 1, 'source_volid': '33734b74-09ed-454a-99ee-fed604d3d356', 'source_volstatus': 'available'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d0d08c-b967-4231-82c1-b5ea9c1dea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d0d08c-b967-4231-82c1-b5ea9c1dea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c955021-edf5-4bd9-9f07-ba148f6f0a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Volume c3ae8519-b58c-42c7-bf86-abd634e31787: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c3ae8519-b58c-42c7-bf86-abd634e31787', 'volume_size': 1, 'source_volid': '33734b74-09ed-454a-99ee-fed604d3d356', 'source_volstatus': 'available'}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (01ea312d-8cf1-479c-a8fe-f44bd81dc992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb4f063-e7f1-498a-8de1-1e46d4001866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack sudo[93155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4
Apr 29 08:47:12 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb4f063-e7f1-498a-8de1-1e46d4001866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1006596956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780b7e98-18a9-4696-abab-3f7430351fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:13Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b85a85-38c3-4c9d-bfea-884fa88cd682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b85a85-38c3-4c9d-bfea-884fa88cd682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f48f5f-216d-42d1-b543-5349ff0d3f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f48f5f-216d-42d1-b543-5349ff0d3f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '780b7e98-18a9-4696-abab-3f7430351fbb', 'volume_name': 'volume-780b7e98-18a9-4696-abab-3f7430351fbb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47da425-d817-42f4-8f52-84cae8af9d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47da425-d817-42f4-8f52-84cae8af9d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043b9797-b6c7-4908-bf8a-0d388ccb103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:12 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume 780b7e98-18a9-4696-abab-3f7430351fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-780b7e98-18a9-4696-abab-3f7430351fbb', 'volume_size': 1}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:12 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (9111aeb3-1b47-4c31-ad54-14fbf1dbe54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044e9f2c-516f-48d3-8027-dee01fd95d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044e9f2c-516f-48d3-8027-dee01fd95d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644288805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d24fe61-601f-4e96-957c-ee38cdeea192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:13Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca25c31-f55c-4b8b-8174-e846c314540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca25c31-f55c-4b8b-8174-e846c314540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bf99e8-01d2-40df-a731-0cfe3edfe5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bf99e8-01d2-40df-a731-0cfe3edfe5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d24fe61-601f-4e96-957c-ee38cdeea192', 'volume_name': 'volume-4d24fe61-601f-4e96-957c-ee38cdeea192', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3885e88-d8c9-4c84-ae3f-c5c4760d3d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3885e88-d8c9-4c84-ae3f-c5c4760d3d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef30159-aafb-40ea-8c1c-e33573e81944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume 4d24fe61-601f-4e96-957c-ee38cdeea192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d24fe61-601f-4e96-957c-ee38cdeea192', 'volume_size': 1}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (d4353241-f288-4fc1-84f3-8e5756e68666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c67de8c-392f-44f9-9a5d-1b8e85b3798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c67de8c-392f-44f9-9a5d-1b8e85b3798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381343619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6d30c9-a95b-4fe6-b6b1-36e21851552c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:13Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c715c1-64fa-46d5-909a-134e7dddb02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c715c1-64fa-46d5-909a-134e7dddb02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba87987-f508-47ac-9264-7faed24bd4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba87987-f508-47ac-9264-7faed24bd4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6d30c9-a95b-4fe6-b6b1-36e21851552c', 'volume_name': 'volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa17a9-4551-4acb-97d4-39d34ed9f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa17a9-4551-4acb-97d4-39d34ed9f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:13 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52aec44-bd35-4f9e-b964-a29bde9e0512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:13 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume 4c6d30c9-a95b-4fe6-b6b1-36e21851552c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c', 'volume_size': 1}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4" returned: 0 in 0.872s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:13 devstack sudo[93168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4
Apr 29 08:47:13 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:13 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 1G" returned: 0 in 0.920s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:13 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:13 devstack sudo[93171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8
Apr 29 08:47:13 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:14 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-32f0cfe5-2523-4580-8cba-f1d10f9a92e4" returned: 0 in 0.633s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-32f0cfe5-2523-4580-8cba-f1d10f9a92e4" released by "delete_volume" :: held 1.583s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:14 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8" returned: 0 in 0.703s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:14 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 is being set with open permissions: ugo+rw
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:14 devstack sudo[93178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8
Apr 29 08:47:14 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created reservations ['8bfb8303-0fd4-45a7-979a-bcfb11e89c2b', '510e05ef-92ce-48b0-9ded-e5837ba4e9fb', 'd1c697ac-09a2-4878-8cb7-482f2eff0e8a', '9b2ddc16-fb7b-4fed-b614-ce56c8d91c3a'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:14 devstack sudo[93180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:14 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-d6b4dc9b-fd67-4bb0-83e1-070da1b17743-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-d6b4dc9b-fd67-4bb0-83e1-070da1b17743-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-quobyte-d6b4dc9b-fd67-4bb0-83e1-070da1b17743" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-d6b4dc9b-fd67-4bb0-83e1-070da1b17743" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c60c299-1d35-49de-a638-127eba387104]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:14 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8" returned: 0 in 0.673s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:14 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:14 devstack sudo[93183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743
Apr 29 08:47:14 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:14 devstack sudo[93185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.info
Apr 29 08:47:14 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:15 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.649s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:15 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:15 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Deleted volume successfully.
Apr 29 08:47:15 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-ea81bf89-8f7d-4717-a067-f36dfc8c6bd5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-32f0cfe5-2523-4580-8cba-f1d10f9a92e4-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:15 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.info" returned: 0 in 0.620s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:15 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.info is being set with open permissions: ugo+rw
Apr 29 08:47:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:15 devstack sudo[93193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.info
Apr 29 08:47:15 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:15 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743" returned: 0 in 0.769s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:15 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:15 devstack sudo[93195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743
Apr 29 08:47:15 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:16 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.info" returned: 0 in 0.614s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.844s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.464s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117895271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c04ec5b-74e2-4f1c-8974-e6919fdeba7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:12Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Creating volume 2c04ec5b-74e2-4f1c-8974-e6919fdeba7e {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:16 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:16 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:16 devstack sudo[93199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e 1073741824
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-d6b4dc9b-fd67-4bb0-83e1-070da1b17743" returned: 0 in 0.653s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:16 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-d6b4dc9b-fd67-4bb0-83e1-070da1b17743" released by "delete_volume" :: held 1.484s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:16 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-3680e9b9-e3fa-431c-8a1a-eacc7dc35306 tempest-SnapshotDependencyTests-1176354595 None] Create snapshot completed successfully
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created reservations ['d41d3b02-ddb5-499c-bf62-ce9f8022fdff', '93f9a297-60e3-47d0-9a20-5480a8c761bc', '2b5dc7a2-da70-435e-9315-3a8b835e1623', 'b8bb0bdc-8d1a-41a8-88c4-b1b6c1e71106'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:16 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:16 devstack sudo[93201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:16 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-b97e561a-deb2-421a-bdd2-9519b8ea5247-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-b97e561a-deb2-421a-bdd2-9519b8ea5247-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-quobyte-b97e561a-deb2-421a-bdd2-9519b8ea5247" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-b97e561a-deb2-421a-bdd2-9519b8ea5247" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbfa0df-d00c-4cf9-b1d2-6932a3e63729]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:17 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.680s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:17 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Deleted volume successfully.
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-1752734d-9ddd-4251-8ee9-d3e4f0dc824b tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-d6b4dc9b-fd67-4bb0-83e1-070da1b17743-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:17 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e 1073741824" returned: 0 in 1.024s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:17 devstack sudo[93208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247
Apr 29 08:47:17 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:17 devstack sudo[93210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e
Apr 29 08:47:17 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Flow 'volume_create_manager' (9856f247-79da-4fc0-9a55-b172b76a2eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5270a97f-b6da-45ab-b2c5-04188630de6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5270a97f-b6da-45ab-b2c5-04188630de6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf871e8f-2564-47d5-8e08-845345785177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c793503e3bbb45ab996590aba632c5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=313da2f2-c4cd-40c0-a872-ba7d1bc528c8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:17Z,use_quota=True,user_id='3eb167d416db405ab994ecb058df6318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac0bac1-e20b-4d37-af31-c900de73c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac0bac1-e20b-4d37-af31-c900de73c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e0f9e8-ed3b-4bf8-b33e-306cc1f3f954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e0f9e8-ed3b-4bf8-b33e-306cc1f3f954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf871e8f-2564-47d5-8e08-845345785177', 'volume_name': 'volume-bf871e8f-2564-47d5-8e08-845345785177', 'volume_size': 1, 'snapshot_id': '313da2f2-c4cd-40c0-a872-ba7d1bc528c8'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d5eb46-8adb-4c4b-b7c7-6be5ac58399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d5eb46-8adb-4c4b-b7c7-6be5ac58399a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191f8721-f470-4f20-9c33-b3a7050d1dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:17 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Volume bf871e8f-2564-47d5-8e08-845345785177: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf871e8f-2564-47d5-8e08-845345785177', 'volume_size': 1, 'snapshot_id': '313da2f2-c4cd-40c0-a872-ba7d1bc528c8'}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:17 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e" returned: 0 in 0.649s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.808s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1388003869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632132c4-a2ed-4bad-bc07-1413e3a01892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:12Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Creating volume 632132c4-a2ed-4bad-bc07-1413e3a01892 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:17 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:17 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247" returned: 0 in 0.832s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:17 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:17 devstack sudo[93216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892 1073741824
Apr 29 08:47:17 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dba255-c32e-418f-ad65-670b7d863f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999d16ca-3565-488b-b280-e9ee2ac14362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:18 devstack sudo[93217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247
Apr 29 08:47:18 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:18 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e (2c04ec5b-74e2-4f1c-8974-e6919fdeba7e): created successfully
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999d16ca-3565-488b-b280-e9ee2ac14362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (90cf18d4-cfd5-46d6-87ee-8e2d339d43db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:18 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-e0238cca-7e63-4481-bad6-e7c3b0bc1ca9 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created volume successfully.
Apr 29 08:47:18 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-b97e561a-deb2-421a-bdd2-9519b8ea5247" returned: 0 in 0.617s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-b97e561a-deb2-421a-bdd2-9519b8ea5247" released by "delete_volume" :: held 1.495s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=141,cinder:SELECT=103,cinder:INSERT=27,cinder:DELETE=16 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created reservations ['24e85f37-4f81-49b0-8824-9ff40cd1aad8', '8fc8955b-ea28-4e0d-8a21-afdde079c1c8', 'e3b11dc3-a05c-42cc-9cfc-a08528f47ea7', '6f0d124a-a062-4856-afd8-ea4312e83d07'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:18 devstack sudo[93224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:18 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:18 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892 1073741824" returned: 0 in 0.832s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:18 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:18 devstack sudo[93226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892
Apr 29 08:47:18 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:SELECT=112,cinder:UPDATE=139,cinder:INSERT=37,cinder:DELETE=13 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-quobyte-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:19 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.637s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Deleted volume successfully.
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[970a323b-70ec-44b9-88fb-3557a4a05881]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-66f2eb14-6766-4876-bc46-8505ebe5479d tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-b97e561a-deb2-421a-bdd2-9519b8ea5247-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:19 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892" returned: 0 in 0.619s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.593s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1006596956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780b7e98-18a9-4696-abab-3f7430351fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:13Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Creating volume 780b7e98-18a9-4696-abab-3f7430351fbb {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:19 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90bb5a16-2c11-4086-878f-b363262984af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632132c4-a2ed-4bad-bc07-1413e3a01892', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776fcbb4-e65a-44f0-906b-cd3f3c449a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:19 devstack sudo[93231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb 1073741824
Apr 29 08:47:19 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:19 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume volume-632132c4-a2ed-4bad-bc07-1413e3a01892 (632132c4-a2ed-4bad-bc07-1413e3a01892): created successfully
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776fcbb4-e65a-44f0-906b-cd3f3c449a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:19 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (c56d06cb-c87d-425d-bdb7-f18a5b0d8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:19 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-ad72084d-82cc-4667-b34e-cefe08b666e1 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created volume successfully.
Apr 29 08:47:19 devstack sudo[93230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e
Apr 29 08:47:19 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:20 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e" returned: 0 in 0.729s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:20 devstack sudo[93241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e
Apr 29 08:47:20 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:20 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb 1073741824" returned: 0 in 0.808s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:20 devstack sudo[93243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb
Apr 29 08:47:20 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:20 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e" returned: 0 in 0.606s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e" released by "delete_volume" :: held 1.391s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created reservations ['d9d3189a-a6d8-4ccb-949e-b95d2c6543b4', 'c15d9583-c336-4685-8593-073419e2264d', '283f1e8f-10ee-44be-a5d1-087148f418c1', '6b7611b0-c164-41ad-934b-51b2c467af05'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:20 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb" returned: 0 in 0.593s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.041s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:20 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Cloning volume 33734b74-09ed-454a-99ee-fed604d3d356 to volume c3ae8519-b58c-42c7-bf86-abd634e31787
Apr 29 08:47:20 devstack sudo[93247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:20 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043b9797-b6c7-4908-bf8a-0d388ccb103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780b7e98-18a9-4696-abab-3f7430351fbb', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0fb8e9-bbba-4a19-b16d-55960c1ecb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:20 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume volume-780b7e98-18a9-4696-abab-3f7430351fbb (780b7e98-18a9-4696-abab-3f7430351fbb): created successfully
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0fb8e9-bbba-4a19-b16d-55960c1ecb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (01ea312d-8cf1-479c-a8fe-f44bd81dc992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Creating offline snapshot d8527737-8148-401f-a9c9-c9eb9e7d73e7 of volume 33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:47:20 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-7da38df6-5750-4873-980c-21604dfa2a3b tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created volume successfully.
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a83e02-3d45-4676-847b-09b82030dd51]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:20 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:21 devstack sudo[93249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356
Apr 29 08:47:21 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:21 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.589s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:21 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Deleted volume successfully.
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-c8404eaa-b41b-4023-b712-d331f508a890-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6c2dbf75-b243-4e86-a251-fa14c8d0cdc5 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-c2fe7f52-b81f-4c38-aa9f-5fd328404d5e-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-c8404eaa-b41b-4023-b712-d331f508a890-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-quobyte-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-quobyte-c8404eaa-b41b-4023-b712-d331f508a890" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-c8404eaa-b41b-4023-b712-d331f508a890" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Deleting offline snapshot c8404eaa-b41b-4023-b712-d331f508a890 of volume 172a7fe5-d3e7-42a2-b43f-5c692bcb5144 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] snapshot_file for this snap is: volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[486cb4ba-51fd-4094-9f6e-64b46687c5b5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:21 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356" returned: 0 in 0.710s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:21 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:21 devstack sudo[93256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890
Apr 29 08:47:21 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:21 devstack sudo[93257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 1G
Apr 29 08:47:21 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:22 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890" returned: 0 in 0.690s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:22 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:47:22 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[42050962-4400-4323-b248-278ea5aa2cdf]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:22 devstack sudo[93266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144
Apr 29 08:47:22 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:22 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 1G" returned: 0 in 0.786s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:22 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33734b74-09ed-454a-99ee-fed604d3d356 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:22 devstack sudo[93269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33734b74-09ed-454a-99ee-fed604d3d356 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7
Apr 29 08:47:22 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:23 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" returned: 0 in 0.700s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:23 devstack sudo[93278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890
Apr 29 08:47:23 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:23 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33734b74-09ed-454a-99ee-fed604d3d356 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7" returned: 0 in 0.655s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:23 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 is being set with open permissions: ugo+rw
Apr 29 08:47:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:23 devstack sudo[93280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7
Apr 29 08:47:23 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:23 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:23 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7" returned: 0 in 0.600s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890" returned: 0 in 0.716s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:23 devstack sudo[93287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890
Apr 29 08:47:23 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:23 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:23 devstack sudo[93289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.info
Apr 29 08:47:23 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:24 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144.c8404eaa-b41b-4023-b712-d331f508a890" returned: 0 in 0.603s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:24 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.info" returned: 0 in 0.616s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:24 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.info is being set with open permissions: ugo+rw
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-c8404eaa-b41b-4023-b712-d331f508a890" released by "_delete_snapshot" :: held 2.845s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" released by "delete_snapshot" :: held 2.871s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:24 devstack sudo[93293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.info
Apr 29 08:47:24 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created reservations ['1622eb66-64e3-413a-b4c3-901066517986', '21db2dd9-3efc-4dee-9316-84ad73b0956c', '05e6f123-d051-4cf5-8d47-de69afea32a6', '3f4b1d4b-315d-4ac3-a174-d01f742c9bcc'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:24 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Delete snapshot completed successfully.
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4be9ecac-53ca-4fa8-afad-ce84f01149a1 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-c8404eaa-b41b-4023-b712-d331f508a890-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-172a7fe5-d3e7-42a2-b43f-5c692bcb5144-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-172a7fe5-d3e7-42a2-b43f-5c692bcb5144-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "cinder-quobyte-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[052bd6ca-3ab2-4ae0-b267-b57c04e0e6c5]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:24 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:24 devstack sudo[93295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144
Apr 29 08:47:24 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:25 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.info" returned: 0 in 0.622s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-c3ae8519-b58c-42c7-bf86-abd634e31787" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-c3ae8519-b58c-42c7-bf86-abd634e31787" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] snapshot: d8527737-8148-401f-a9c9-c9eb9e7d73e7, volume: c3ae8519-b58c-42c7-bf86-abd634e31787,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[f878cb59-a9a1-4c6c-a67b-ffa6df7e08e8]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:25 devstack sudo[93332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7
Apr 29 08:47:25 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:25 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" returned: 0 in 0.718s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:25 devstack sudo[93341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144
Apr 29 08:47:25 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:25 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7" returned: 0 in 0.807s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33734b74-09ed-454a-99ee-fed604d3d356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[aded8b94-30f5-428f-9a6d-be387efdb93d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:25 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:26 devstack sudo[93346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356
Apr 29 08:47:26 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:26 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" returned: 0 in 0.624s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-quobyte-172a7fe5-d3e7-42a2-b43f-5c692bcb5144" released by "delete_volume" :: held 1.412s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Created reservations ['5602d4dd-7a91-4ed1-9689-1c8d3c00dafd', 'ce42f98f-9f91-4bf9-8216-fe91f9d5265f', '9df063ce-acfa-4ea7-9d62-0f894935039b', 'f6ab310b-55d7-4b44-a5a1-14c969e6aea6'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:26 devstack sudo[93349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:26 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:26 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356" returned: 0 in 0.739s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787 not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:26 devstack sudo[93354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787
Apr 29 08:47:26 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:26 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.632s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:26 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:26 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Deleted volume successfully.
Apr 29 08:47:27 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fc4f7307-5fc4-4acf-a57a-07fb5be7aab3 tempest-CreateVolumesFromSnapshotTest-1103058577 None] Lock "cinder-172a7fe5-d3e7-42a2-b43f-5c692bcb5144-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:31 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787" returned: 0 in 5.013s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:31 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[8909fb35-8abb-4bd4-87cb-689aedac9ff2]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:31 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:31 devstack sudo[93369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356
Apr 29 08:47:31 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Flow 'volume_create_manager' (50b068fa-8e3d-41d1-8f57-362e13c2d22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf63579e-36b3-4c1e-a48a-99b10b880dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf63579e-36b3-4c1e-a48a-99b10b880dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdaaded-ac55-43a1-8b6c-266fe0e0bf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc50b4c27d7f49bd93a85897e89b6633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:32Z,use_quota=True,user_id='6608041b3701449aa576b96926854f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381759ac-6924-4bc7-a97f-d6cf121eed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381759ac-6924-4bc7-a97f-d6cf121eed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee99e14-0c08-43c7-9284-8aa1af6bf457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee99e14-0c08-43c7-9284-8aa1af6bf457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfdaaded-ac55-43a1-8b6c-266fe0e0bf10', 'volume_name': 'volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679db04d-3dd3-4cf2-bff9-776d40b1b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679db04d-3dd3-4cf2-bff9-776d40b1b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf1068d-1f72-49ca-8a3b-eaf09969f4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:32 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Volume dfdaaded-ac55-43a1-8b6c-266fe0e0bf10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10', 'volume_size': 1}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:32 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356" returned: 0 in 0.851s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:47:32 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Converted 1024.00 MB image at 204.25 MB/s
Apr 29 08:47:32 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787 is being set with open permissions: ugo+rw
Apr 29 08:47:32 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:32 devstack sudo[93380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787
Apr 29 08:47:32 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:33 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787" returned: 0 in 0.562s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-c3ae8519-b58c-42c7-bf86-abd634e31787" released by "_copy_volume_from_snapshot" :: held 8.065s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-d8527737-8148-401f-a9c9-c9eb9e7d73e7" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-d8527737-8148-401f-a9c9-c9eb9e7d73e7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Deleting offline snapshot d8527737-8148-401f-a9c9-c9eb9e7d73e7 of volume 33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] snapshot_file for this snap is: volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[383efccb-9ff1-4aa5-8575-c7f8523cb1f9]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:33 devstack sudo[93383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7
Apr 29 08:47:33 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:33 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7" returned: 0 in 0.711s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33734b74-09ed-454a-99ee-fed604d3d356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43e0156-9933-41f5-9937-884c9bef367e]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:33 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:34 devstack sudo[93389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356
Apr 29 08:47:34 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:34 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356" returned: 0 in 0.688s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:34 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:34 devstack sudo[93395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7
Apr 29 08:47:34 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:35 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7" returned: 0 in 0.679s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:35 devstack sudo[93400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7
Apr 29 08:47:35 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:35 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356.d8527737-8148-401f-a9c9-c9eb9e7d73e7" returned: 0 in 0.607s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-d8527737-8148-401f-a9c9-c9eb9e7d73e7" released by "_delete_snapshot" :: held 2.779s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.070s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.906s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644288805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d24fe61-601f-4e96-957c-ee38cdeea192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:13Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Creating volume 4d24fe61-601f-4e96-957c-ee38cdeea192 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:35 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:35 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:36 devstack sudo[93403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192 1073741824
Apr 29 08:47:36 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c955021-edf5-4bd9-9f07-ba148f6f0a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ae8519-b58c-42c7-bf86-abd634e31787', 'volume_size': 1, 'source_volid': '33734b74-09ed-454a-99ee-fed604d3d356', 'source_volstatus': 'available'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25549b47-6678-401c-8153-abc282183345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:36 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Volume volume-c3ae8519-b58c-42c7-bf86-abd634e31787 (c3ae8519-b58c-42c7-bf86-abd634e31787): created successfully
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25549b47-6678-401c-8153-abc282183345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Flow 'volume_create_manager' (208d88d5-c3df-4d79-a77a-07854954ff2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:36 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-172969bc-3c5c-4035-9123-cfaa7a8d526a tempest-VolumeDependencyTests-582183731 None] Created volume successfully.
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-33734b74-09ed-454a-99ee-fed604d3d356-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-33734b74-09ed-454a-99ee-fed604d3d356-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-33734b74-09ed-454a-99ee-fed604d3d356" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-33734b74-09ed-454a-99ee-fed604d3d356" acquired by "delete_volume" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee029b88-9ad9-428c-b0ab-14f2e883c3e3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:36 devstack sudo[93405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356
Apr 29 08:47:36 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:36 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192 1073741824" returned: 0 in 0.845s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:36 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:36 devstack sudo[93410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192
Apr 29 08:47:36 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:37 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356" returned: 0 in 0.820s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:37 devstack sudo[93415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356
Apr 29 08:47:37 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:37 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192" returned: 0 in 0.612s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.035s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-381343619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6d30c9-a95b-4fe6-b6b1-36e21851552c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4306c98b4034580bdeb12de99560c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:13Z,use_quota=True,user_id='51020042dba647ffbcfab1ff01e3b3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Creating volume 4c6d30c9-a95b-4fe6-b6b1-36e21851552c {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:37 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:37 devstack sudo[93418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c 1073741824
Apr 29 08:47:37 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef30159-aafb-40ea-8c1c-e33573e81944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d24fe61-601f-4e96-957c-ee38cdeea192', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64383b8e-1b61-4b99-a470-f740c7ca45a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:37 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume volume-4d24fe61-601f-4e96-957c-ee38cdeea192 (4d24fe61-601f-4e96-957c-ee38cdeea192): created successfully
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64383b8e-1b61-4b99-a470-f740c7ca45a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (9111aeb3-1b47-4c31-ad54-14fbf1dbe54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:37 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-68a3b08c-3452-449a-a64d-a830781e717a tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created volume successfully.
Apr 29 08:47:37 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-33734b74-09ed-454a-99ee-fed604d3d356" returned: 0 in 0.618s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-33734b74-09ed-454a-99ee-fed604d3d356" released by "delete_volume" :: held 1.509s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Created reservations ['c2ec6678-8abd-4e7f-ae80-6f95389b8163', 'ace9c3d1-859a-4f5f-a7ec-892703bae8e4', 'ce865e79-b78a-4975-836d-6d08e0f1ebcd', 'c2e9d318-0dbc-4f28-9e8a-1570e9aa6e28'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:37 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:38 devstack sudo[93421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:38 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:38 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c 1073741824" returned: 0 in 0.844s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:38 devstack sudo[93426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c
Apr 29 08:47:38 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-c3ae8519-b58c-42c7-bf86-abd634e31787-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Lock "cinder-c3ae8519-b58c-42c7-bf86-abd634e31787-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-c3ae8519-b58c-42c7-bf86-abd634e31787" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-c3ae8519-b58c-42c7-bf86-abd634e31787" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0863c47-6e57-4b88-9cbb-f981d9f41ac3]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:38 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.652s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:38 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Deleted volume successfully.
Apr 29 08:47:38 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-6ef8410c-b48a-4608-b1a2-2e66024a3874 tempest-VolumeDependencyTests-582183731 None] Lock "cinder-33734b74-09ed-454a-99ee-fed604d3d356-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:38 devstack sudo[93429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787
Apr 29 08:47:38 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:39 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c" returned: 0 in 0.662s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 21.498s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "cinder-quobyte-313da2f2-c4cd-40c0-a872-ba7d1bc528c8-bf871e8f-2564-47d5-8e08-845345785177" by "_create_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52aec44-bd35-4f9e-b964-a29bde9e0512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6296e9b8-0ae3-4e8b-86e1-fb066d46996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-313da2f2-c4cd-40c0-a872-ba7d1bc528c8-bf871e8f-2564-47d5-8e08-845345785177" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Creating volume bf871e8f-2564-47d5-8e08-845345785177 from snapshot 313da2f2-c4cd-40c0-a872-ba7d1bc528c8 {{(pid=83885) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "cinder-quobyte-bf871e8f-2564-47d5-8e08-845345785177" by "_copy_volume_from_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:39 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Volume volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c (4c6d30c9-a95b-4fe6-b6b1-36e21851552c): created successfully
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6296e9b8-0ae3-4e8b-86e1-fb066d46996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Flow 'volume_create_manager' (d4353241-f288-4fc1-84f3-8e5756e68666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-bf871e8f-2564-47d5-8e08-845345785177" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] snapshot: 313da2f2-c4cd-40c0-a872-ba7d1bc528c8, volume: bf871e8f-2564-47d5-8e08-845345785177,  {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:47:39 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-1b3fb51f-dbd4-4215-9626-7282a6a83c06 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created volume successfully.
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd39ea5c-7b6b-4d15-864f-b9994b722b06]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:39 devstack sudo[93432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8
Apr 29 08:47:39 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:39 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787" returned: 0 in 0.774s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-4c6d30c9-a95b-4fe6-b6b1-36e21851552c-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:39 devstack sudo[93437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787
Apr 29 08:47:39 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-4c6d30c9-a95b-4fe6-b6b1-36e21851552c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-quobyte-4c6d30c9-a95b-4fe6-b6b1-36e21851552c" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-4c6d30c9-a95b-4fe6-b6b1-36e21851552c" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b831769-8aae-403e-95e6-2f5252812a33]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:39 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:39 devstack sudo[93439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c
Apr 29 08:47:39 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:40 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8" returned: 0 in 0.817s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Creating direct copy from snapshot {{(pid=83885) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d0266a-a914-4c6e-b567-a5a9072e52b8]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:40 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-c3ae8519-b58c-42c7-bf86-abd634e31787" returned: 0 in 0.698s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-c3ae8519-b58c-42c7-bf86-abd634e31787" released by "delete_volume" :: held 1.527s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:40 devstack sudo[93445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a
Apr 29 08:47:40 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Created reservations ['b7ac33c2-38d5-4766-a0ac-d3db02e7f979', '01b8d0b3-706e-47f4-85ff-e655bdedb7c4', '0d345379-7712-44fe-b210-5e1c021d81cf', '4ef3d80a-81b6-4ba4-a656-c1f44123fa33'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:40 devstack sudo[93450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:40 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:40 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c" returned: 0 in 0.787s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:40 devstack sudo[93452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c
Apr 29 08:47:40 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:40 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-9420d643-5038-421f-8e6d-5a97ee834441-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" returned: 0 in 0.816s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.utils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Path /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177 not found in is_blk_device check {{(pid=83885) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Lock "cinder-9420d643-5038-421f-8e6d-5a97ee834441-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:40 devstack sudo[93459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177
Apr 29 08:47:40 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:40 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Acquiring lock "cinder-quobyte-9420d643-5038-421f-8e6d-5a97ee834441" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.711s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:40 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:41 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Deleted volume successfully.
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-9420d643-5038-421f-8e6d-5a97ee834441" acquired by "delete_volume" :: waited 0.038s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-d2507064-5b76-4fa1-87e9-24621a8dd2ff tempest-VolumeDependencyTests-582183731 None] Lock "cinder-c3ae8519-b58c-42c7-bf86-abd634e31787-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:41 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[474602f8-1c79-4408-acf9-96a4c58b86b7]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4c6d30c9-a95b-4fe6-b6b1-36e21851552c" returned: 0 in 0.739s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-4c6d30c9-a95b-4fe6-b6b1-36e21851552c" released by "delete_volume" :: held 1.576s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created reservations ['7966ca80-96c3-471d-8365-11fed08c1ef3', '53193f95-07a8-434e-b7b4-58240c024d01', 'd1dba1f6-3ad0-40f2-97b9-deade6018d94', '98e08f61-b297-4bb9-9026-dbc66ae9f7ee'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:41 devstack sudo[93462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441
Apr 29 08:47:41 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:41 devstack sudo[93464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:41 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-4d24fe61-601f-4e96-957c-ee38cdeea192-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-4d24fe61-601f-4e96-957c-ee38cdeea192-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-quobyte-4d24fe61-601f-4e96-957c-ee38cdeea192" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-4d24fe61-601f-4e96-957c-ee38cdeea192" acquired by "delete_volume" :: waited 0.063s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[1375f302-5541-4f4f-b31b-3b94f4ee64e4]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:41 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:42 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441" returned: 0 in 0.936s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:42 devstack sudo[93481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441
Apr 29 08:47:42 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:42 devstack sudo[93480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192
Apr 29 08:47:42 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:42 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:42 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.931s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:42 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:42 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Deleted volume successfully.
Apr 29 08:47:42 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-785c629c-e8ab-4371-a8e0-f3c705d89f14 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-4c6d30c9-a95b-4fe6-b6b1-36e21851552c-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:43 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-9420d643-5038-421f-8e6d-5a97ee834441" returned: 0 in 1.663s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:43 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Lock "cinder-quobyte-9420d643-5038-421f-8e6d-5a97ee834441" released by "delete_volume" :: held 2.694s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:43 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Created reservations ['ecd5095e-40ea-4f4e-a2f8-fbc500043214', '5fcaa83a-9ebb-4781-a908-d3fdf562a160', '4f2b16e1-9ec3-47f5-8abe-d4839224340d', '4a03219e-314e-499c-919f-66ddd65ffb83'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:43 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192" returned: 0 in 1.992s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:43 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:43 devstack sudo[93490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192
Apr 29 08:47:43 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:44 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:44 devstack sudo[93492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:44 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:44 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:44 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-4d24fe61-601f-4e96-957c-ee38cdeea192" returned: 0 in 0.978s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:44 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-4d24fe61-601f-4e96-957c-ee38cdeea192" released by "delete_volume" :: held 3.080s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created reservations ['4ca397de-c54c-4e46-b003-a842b3563032', '35ac892f-bf3a-4f02-b22f-21ab32444bdf', 'e2f16301-e6fb-4373-b2b4-59258a76e58f', 'f5ccf55b-8180-44ea-980b-070a06a57e05'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:45 devstack sudo[93495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:45 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-780b7e98-18a9-4696-abab-3f7430351fbb-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-780b7e98-18a9-4696-abab-3f7430351fbb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-quobyte-780b7e98-18a9-4696-abab-3f7430351fbb" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-780b7e98-18a9-4696-abab-3f7430351fbb" acquired by "delete_volume" :: waited 0.044s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e4fe7-b186-4f4d-8a81-833597050f31]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:45 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.918s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:45 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:46 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Deleted volume successfully.
Apr 29 08:47:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-433a0131-8aaf-4370-9d59-47261dd50bfe tempest-VolumeDependencyTests-582183731 None] Lock "cinder-9420d643-5038-421f-8e6d-5a97ee834441-delete_volume" released by "delete_volume" :: held 5.144s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:46 devstack sudo[93498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb
Apr 29 08:47:46 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:46 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:46 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 1.546s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:46 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:46 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Deleted volume successfully.
Apr 29 08:47:46 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-4d472e67-772b-4c7b-abd8-9943a147bfa6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-4d24fe61-601f-4e96-957c-ee38cdeea192-delete_volume" released by "delete_volume" :: held 5.141s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:47 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177" returned: 0 in 6.339s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:47 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446bafa-fd7d-4cbb-98cf-1af92de81c81]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:47 devstack sudo[93501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a
Apr 29 08:47:47 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:47 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb" returned: 0 in 1.643s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:47 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:47 devstack sudo[93506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb
Apr 29 08:47:47 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:48 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" returned: 0 in 1.031s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG cinder.image.image_utils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177 {{(pid=83885) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:47:48 devstack cinder-volume[83885]: INFO cinder.image.image_utils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Converted 1024.00 MB image at 161.50 MB/s
Apr 29 08:47:48 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177 is being set with open permissions: ugo+rw
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:48 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:48 devstack sudo[93512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177
Apr 29 08:47:48 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-780b7e98-18a9-4696-abab-3f7430351fbb" returned: 0 in 0.722s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-780b7e98-18a9-4696-abab-3f7430351fbb" released by "delete_volume" :: held 2.503s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created reservations ['1732717d-1edc-4038-9606-12e1353fd13d', '4d0e1e16-0d74-44ac-a960-96a9c14eb3f4', 'fe35fc40-b05c-47a1-82dd-60507711d934', 'f0057bf5-92ca-4ae8-9f2e-3624454a536e'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:48 devstack sudo[93514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:48 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:48 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:48 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177" returned: 0 in 0.726s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-bf871e8f-2564-47d5-8e08-845345785177" released by "_copy_volume_from_snapshot" :: held 9.856s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-313da2f2-c4cd-40c0-a872-ba7d1bc528c8-bf871e8f-2564-47d5-8e08-845345785177" released by "_create_volume_from_snapshot" :: held 9.910s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.950s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.645s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdaaded-ac55-43a1-8b6c-266fe0e0bf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc50b4c27d7f49bd93a85897e89b6633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:32Z,use_quota=True,user_id='6608041b3701449aa576b96926854f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Creating volume dfdaaded-ac55-43a1-8b6c-266fe0e0bf10 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:49 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:49 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:49 devstack sudo[93518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10 1073741824
Apr 29 08:47:49 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.636s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:49 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Deleted volume successfully.
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191f8721-f470-4f20-9c33-b3a7050d1dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf871e8f-2564-47d5-8e08-845345785177', 'volume_size': 1, 'snapshot_id': '313da2f2-c4cd-40c0-a872-ba7d1bc528c8'}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f033a39-0500-4a9a-a3e2-0ae0b07a3536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:49 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Volume volume-bf871e8f-2564-47d5-8e08-845345785177 (bf871e8f-2564-47d5-8e08-845345785177): created successfully
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f033a39-0500-4a9a-a3e2-0ae0b07a3536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Flow 'volume_create_manager' (9856f247-79da-4fc0-9a55-b172b76a2eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-08343104-72f9-4120-9e9b-6e28dcd62f72 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-780b7e98-18a9-4696-abab-3f7430351fbb-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:49 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-b0b37559-62f9-4d8f-a74c-eeb408767d40 tempest-SnapshotDependencyTests-1176354595 None] Created volume successfully.
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-632132c4-a2ed-4bad-bc07-1413e3a01892-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-632132c4-a2ed-4bad-bc07-1413e3a01892-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-quobyte-632132c4-a2ed-4bad-bc07-1413e3a01892" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-632132c4-a2ed-4bad-bc07-1413e3a01892" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "cinder-313da2f2-c4cd-40c0-a872-ba7d1bc528c8-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-313da2f2-c4cd-40c0-a872-ba7d1bc528c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "cinder-quobyte-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa60bcd-0080-4b24-beca-185eb798ed39]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "cinder-quobyte-313da2f2-c4cd-40c0-a872-ba7d1bc528c8" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-313da2f2-c4cd-40c0-a872-ba7d1bc528c8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Deleting offline snapshot 313da2f2-c4cd-40c0-a872-ba7d1bc528c8 of volume 05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] snapshot_file for this snap is: volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ba255c-8687-40c5-b5f1-e8b038964137]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:49 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892
Apr 29 08:47:49 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:49 devstack sudo[93521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8
Apr 29 08:47:49 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_service.periodic_task [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83885) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:49 devstack sudo[93528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:49 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:49 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10 1073741824" returned: 0 in 0.887s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:49 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:49 devstack sudo[93530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10
Apr 29 08:47:49 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:50 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8" returned: 0 in 0.851s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:47:50 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892" returned: 0 in 0.982s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[5172dc65-1342-4120-90c5-d027cb293848]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:50 devstack sudo[93541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892
Apr 29 08:47:50 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:50 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.678s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-6d072da9-68b1-47cb-a8e9-25dfb1ab7306 None None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:50 devstack sudo[93542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a
Apr 29 08:47:50 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:50 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10" returned: 0 in 0.736s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf1068d-1f72-49ca-8a3b-eaf09969f4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b2d71d-39ba-43d9-924d-ea836168327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:50 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Volume volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10 (dfdaaded-ac55-43a1-8b6c-266fe0e0bf10): created successfully
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b2d71d-39ba-43d9-924d-ea836168327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:50 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Flow 'volume_create_manager' (50b068fa-8e3d-41d1-8f57-362e13c2d22f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:50 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-d80444e8-a3e6-4c6e-bdb8-c09f4ad452dd tempest-CinderUnicodeTest-1768026931 None] Created volume successfully.
Apr 29 08:47:51 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-632132c4-a2ed-4bad-bc07-1413e3a01892" returned: 0 in 0.661s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-632132c4-a2ed-4bad-bc07-1413e3a01892" released by "delete_volume" :: held 1.712s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created reservations ['4f57c0d8-2b1a-4684-b163-3a1a6004e00e', '12de3fe1-2174-4fb3-9853-27229aaab9c5', '9e8394e6-181c-4b71-a8af-395c2fdfc389', '852f74ab-5c53-4a17-b32e-40e68fe23a3d'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:51 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" returned: 0 in 0.793s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:51 devstack sudo[93550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8
Apr 29 08:47:51 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:51 devstack sudo[93552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:51 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83885) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Flow 'volume_create_manager' (2ed73fea-33e7-4315-ae82-6cfee3af69a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1871922-edad-4d29-84ab-b0ec4dce5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1871922-edad-4d29-84ab-b0ec4dce5632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-995913503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccee0bb-71d0-4f8c-89a7-ae334a3d4135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc50b4c27d7f49bd93a85897e89b6633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:52Z,use_quota=True,user_id='6608041b3701449aa576b96926854f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce1d800-9b5d-47f5-bc49-4399cb8465d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce1d800-9b5d-47f5-bc49-4399cb8465d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b38e0da-b757-40ec-9aac-0804a5ba4ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b38e0da-b757-40ec-9aac-0804a5ba4ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eccee0bb-71d0-4f8c-89a7-ae334a3d4135', 'volume_name': 'volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd841455-ee63-4608-844c-b8c0bbbbd9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd841455-ee63-4608-844c-b8c0bbbbd9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c635dfbc-473e-4579-bbd0-bf68b6e8f4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:51 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Volume eccee0bb-71d0-4f8c-89a7-ae334a3d4135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135', 'volume_size': 1}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dcf2f378ce0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:47:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-995913503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccee0bb-71d0-4f8c-89a7-ae334a3d4135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc50b4c27d7f49bd93a85897e89b6633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:47:52Z,use_quota=True,user_id='6608041b3701449aa576b96926854f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(443aba9f-c532-4129-9c45-92bb997467be),volume_type_id=443aba9f-c532-4129-9c45-92bb997467be)}" {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Creating volume eccee0bb-71d0-4f8c-89a7-ae334a3d4135 {{(pid=83885) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Selected osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9 as target Quobyte volume. {{(pid=83885) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:47:51 devstack cinder-volume[83885]: INFO cinder.volume.drivers.remotefs [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] casted to osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 1073741824 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-quobyte-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:51 devstack sudo[93554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 1073741824
Apr 29 08:47:51 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e" acquired by "delete_volume" :: waited 0.021s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[881012f0-b0e4-472a-8a5c-feb13488148d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:51 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:51 devstack sudo[93559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e
Apr 29 08:47:51 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:52 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8" returned: 0 in 0.782s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:52 devstack sudo[93563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8
Apr 29 08:47:52 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:52 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.825s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:52 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Deleted volume successfully.
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7de932c4-0662-4f51-addb-0232df24442c tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-632132c4-a2ed-4bad-bc07-1413e3a01892-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:52 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 1073741824" returned: 0 in 0.835s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:52 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e" returned: 0 in 0.793s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:52 devstack sudo[93572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e
Apr 29 08:47:52 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:52 devstack sudo[93574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135
Apr 29 08:47:52 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:52 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a.313da2f2-c4cd-40c0-a872-ba7d1bc528c8" returned: 0 in 0.727s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-313da2f2-c4cd-40c0-a872-ba7d1bc528c8" released by "_delete_snapshot" :: held 3.310s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" released by "delete_snapshot" :: held 3.336s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Created reservations ['a99ba0cd-b3fa-4075-a673-26af82801411', '2db1cfa6-2c84-480f-b095-0a929d96f308', '92ebc2ab-726c-4c8f-bc64-da9125225f23', '26f4e4b4-f493-4e4d-8d9c-3a9af03325b5'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:52 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Delete snapshot completed successfully.
Apr 29 08:47:52 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-dfd06426-dfa5-4262-a10b-497644b13b85 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-313da2f2-c4cd-40c0-a872-ba7d1bc528c8-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:53 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e" returned: 0 in 0.625s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e" released by "delete_volume" :: held 1.466s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:53 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" returned: 0 in 0.667s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'} {{(pid=83885) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created reservations ['eee7d841-fee6-49d7-8445-7dbfd6959827', '82d6843c-3b53-4bcb-9883-e318154013bc', 'de241503-7360-48cf-96c1-f6683e694381', 'e9afbee7-3d4b-48be-a952-0b295b5a32d8'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c635dfbc-473e-4579-bbd0-bf68b6e8f4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135', 'volume_size': 1}' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bdaff3-e79a-48a2-baec-0b97966d1ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:47:53 devstack cinder-volume[83885]: INFO cinder.volume.flows.manager.create_volume [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Volume volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 (eccee0bb-71d0-4f8c-89a7-ae334a3d4135): created successfully
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37bdaff3-e79a-48a2-baec-0b97966d1ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83885) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Flow 'volume_create_manager' (2ed73fea-33e7-4315-ae82-6cfee3af69a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83885) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:47:53 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-07c26cb7-0ea3-4589-8800-7387b04442b2 tempest-CinderUnicodeTest-1768026931 None] Created volume successfully.
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:53 devstack sudo[93578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:53 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "cinder-05b2b403-28ed-4c3f-baf8-4aac854a5c9a-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-05b2b403-28ed-4c3f-baf8-4aac854a5c9a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "cinder-quobyte-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" acquired by "delete_volume" :: waited 0.027s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:53 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f352b5-f9b2-4b5e-a9c5-50dd64a24e02]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "cinder-quobyte-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7" acquired by "delete_volume" :: waited 0.025s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa313856-2e5a-420e-b3bc-e6ee29cfd700]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:54 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Creating offline snapshot 9fd38056-80d1-49f4-a5f6-cc50de194465 of volume eccee0bb-71d0-4f8c-89a7-ae334a3d4135 {{(pid=83885) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.708s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:54 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Deleted volume successfully.
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a876d8a-cac2-4f37-b31b-524e6c297e6d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:54 devstack sudo[93581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a
Apr 29 08:47:54 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-8e493d37-b53b-4156-88f4-308377fa7bb6 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-2c04ec5b-74e2-4f1c-8974-e6919fdeba7e-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:54 devstack sudo[93583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7
Apr 29 08:47:54 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:54 devstack sudo[93585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135
Apr 29 08:47:54 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:54 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7" returned: 0 in 0.725s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:54 devstack sudo[93597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7
Apr 29 08:47:54 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:54 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" returned: 0 in 0.909s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:54 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:54 devstack sudo[93599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a
Apr 29 08:47:54 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" returned: 0 in 0.749s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:54 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 1G {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:54 devstack sudo[93601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 1G
Apr 29 08:47:54 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:55 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" returned: 0 in 0.610s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-05b2b403-28ed-4c3f-baf8-4aac854a5c9a" released by "delete_volume" :: held 1.616s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Created reservations ['1496744f-a904-45ef-954f-9ec0a2f95e60', 'ff9ef648-e87e-4326-8497-d7c579a84d2a', 'fa52c5c4-b9d7-437c-960d-5028fe50bb04', 'c0633d92-162a-4a7e-9ba3-ceae1567a97c'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:55 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7" returned: 0 in 0.738s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-quobyte-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7" released by "delete_volume" :: held 1.526s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:55 devstack sudo[93609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Created reservations ['faa01abf-6025-47d7-9c21-a3594a07c958', '4409eff8-41b1-4c51-a078-db181009a35c', '2d0c7427-9690-4aa7-af0a-bacc17429967', 'd40deeb3-3724-449c-a5c9-953e87acb915'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:55 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:55 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 1G" returned: 0 in 0.804s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:55 devstack sudo[93611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465
Apr 29 08:47:55 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:55 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:55 devstack sudo[93613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:55 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "cinder-bf871e8f-2564-47d5-8e08-845345785177-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-bf871e8f-2564-47d5-8e08-845345785177-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "cinder-quobyte-bf871e8f-2564-47d5-8e08-845345785177" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-bf871e8f-2564-47d5-8e08-845345785177" acquired by "delete_volume" :: waited 0.024s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:56 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.683s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Deleted volume successfully.
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[6514c62d-9e2f-4690-8fde-0ee562924fdf]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0b4d664c-5c34-4f4b-81fc-c89780b04f12 tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-05b2b403-28ed-4c3f-baf8-4aac854a5c9a-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:56 devstack sudo[93619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177
Apr 29 08:47:56 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:56 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.723s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:56 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Deleted volume successfully.
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-7a550b7c-5b13-4a8f-9b20-26c4e1d070b7 tempest-CreateVolumesFromSourceVolumeTest-1062450877 None] Lock "cinder-767375a1-0ca3-4eb8-83e4-a0e468a8e8e7-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:56 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 -F qcow2 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465" returned: 0 in 0.888s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:56 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 is being set with open permissions: ugo+rw
Apr 29 08:47:56 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:56 devstack sudo[93623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465
Apr 29 08:47:56 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:57 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177" returned: 0 in 0.811s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:57 devstack sudo[93629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177
Apr 29 08:47:57 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:57 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465" returned: 0 in 0.672s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:57 devstack sudo[93631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.info
Apr 29 08:47:57 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:57 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:57 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-bf871e8f-2564-47d5-8e08-845345785177" returned: 0 in 0.677s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:57 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-quobyte-bf871e8f-2564-47d5-8e08-845345785177" released by "delete_volume" :: held 1.575s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:57 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Created reservations ['b2bdb8e8-adbb-451c-8544-6c6b1c16fe55', 'a636779b-983b-4968-8b1a-7ca678bf27ea', 'cf1d925c-04d9-4f78-8fdb-25856ffcc65c', 'f49ed4c6-4ea1-40b5-8def-83ba002b0a2a'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:58 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.info" returned: 0 in 0.669s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:58 devstack cinder-volume[83885]: WARNING cinder.volume.drivers.remotefs [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.info is being set with open permissions: ugo+rw
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.info {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:58 devstack sudo[93635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.info
Apr 29 08:47:58 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:58 devstack sudo[93637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:47:58 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:58 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.info" returned: 0 in 0.613s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.511s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:58 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-11721e80-1abb-45ce-81bd-07811c6b0647 tempest-CinderUnicodeTest-1768026931 None] Create snapshot completed successfully
Apr 29 08:47:58 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.627s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:58 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Deleted volume successfully.
Apr 29 08:47:58 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0808c0f1-20d8-4520-b598-30e02033c26e tempest-SnapshotDependencyTests-1176354595 None] Lock "cinder-bf871e8f-2564-47d5-8e08-845345785177-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "cinder-9fd38056-80d1-49f4-a5f6-cc50de194465-delete_snapshot" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-9fd38056-80d1-49f4-a5f6-cc50de194465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "cinder-quobyte-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" by "delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-quobyte-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "cinder-quobyte-9fd38056-80d1-49f4-a5f6-cc50de194465" by "_delete_snapshot" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-quobyte-9fd38056-80d1-49f4-a5f6-cc50de194465" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Deleting offline snapshot 9fd38056-80d1-49f4-a5f6-cc50de194465 of volume eccee0bb-71d0-4f8c-89a7-ae334a3d4135 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] snapshot_file for this snap is: volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 {{(pid=83885) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f4d2f-07a8-488a-9692-d2bdcc41b954]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:59 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:59 devstack sudo[93641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465
Apr 29 08:47:59 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:00 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465" returned: 0 in 0.729s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:00 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.remotefs [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83885) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:48:00 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[203be4ca-6a78-46c0-ba6c-0eab5756cf2f]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:48:00 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:48:00 devstack sudo[93647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135
Apr 29 08:48:00 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:01 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" returned: 0 in 0.719s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:48:01 devstack sudo[93652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465
Apr 29 08:48:01 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:01 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465" returned: 0 in 0.829s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:01 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:48:01 devstack sudo[93657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465
Apr 29 08:48:01 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:02 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:02 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135.9fd38056-80d1-49f4-a5f6-cc50de194465" returned: 0 in 0.665s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-quobyte-9fd38056-80d1-49f4-a5f6-cc50de194465" released by "_delete_snapshot" :: held 3.050s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:48:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-quobyte-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" released by "delete_snapshot" :: held 3.073s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:48:02 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Created reservations ['7df1f721-7a28-480e-a1ff-da6f985be591', 'b0c5bf73-4737-4ba0-86cc-2ff323b9d6f6', '8e2971da-8a92-4e52-b506-b294f5202bab', '0c98f65c-0fc2-4bcb-ad6d-e759198b4450'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:48:02 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Delete snapshot completed successfully.
Apr 29 08:48:02 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-25df6e21-ba47-47a0-b101-1a0eb6dde1c2 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-9fd38056-80d1-49f4-a5f6-cc50de194465-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:48:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "cinder-eccee0bb-71d0-4f8c-89a7-ae334a3d4135-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:48:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-eccee0bb-71d0-4f8c-89a7-ae334a3d4135-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:48:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "cinder-quobyte-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:48:03 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-quobyte-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" acquired by "delete_volume" :: waited 0.017s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:48:03 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b26da7f-af61-4a24-8d53-71f12539810d]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:48:03 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:48:03 devstack sudo[93663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135
Apr 29 08:48:03 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:04 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" returned: 0 in 0.757s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:04 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:48:04 devstack sudo[93668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135
Apr 29 08:48:04 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:05 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" returned: 0 in 0.666s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-quobyte-eccee0bb-71d0-4f8c-89a7-ae334a3d4135" released by "delete_volume" :: held 1.484s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Created reservations ['bfd51e03-4c92-46e1-b0c7-dc7417bceffc', '6f94db9a-5333-4d2a-8bc0-565e5c0bfe78', 'aab27a1b-480e-4bdb-ba9a-8e16c82e12d7', 'bc76774f-7046-40f9-bf92-d9a63acf09ab'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:48:05 devstack sudo[93671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:48:05 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:05 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "cinder-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10-delete_volume" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:48:06 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.644s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:48:06 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Deleted volume successfully.
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "cinder-quobyte-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10" by "delete_volume" {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-fbd14aa6-4a9d-4e67-96fa-db4b396750b8 tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-eccee0bb-71d0-4f8c-89a7-ae334a3d4135-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-quobyte-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10" acquired by "delete_volume" :: waited 0.022s {{(pid=83885) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d715ca-e123-43c2-86e6-51d67f0f8544]: (4, 'qcow2') {{(pid=84946) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:48:06 devstack sudo[93675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10
Apr 29 08:48:06 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:06 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10" returned: 0 in 0.786s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:06 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:48:06 devstack sudo[93680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10
Apr 29 08:48:06 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:07 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073/volume-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10" returned: 0 in 0.633s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:07 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-quobyte-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10" released by "delete_volume" :: held 1.466s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:48:07 devstack cinder-volume[83885]: DEBUG cinder.quota [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Created reservations ['7e6b1bf5-d226-497f-aad7-8419444479ea', '63488326-3ca9-44bb-a309-67aec1bcb2c2', 'ccbd6611-2f12-4ac5-895e-bd6ff9b8accb', 'c2062158-8061-4693-8054-3d89d14f52bd'] {{(pid=83885) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:48:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:48:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:48:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9': None} {{(pid=83885) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:48:07 devstack cinder-volume[83885]: DEBUG cinder.volume.drivers.quobyte [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fbcd5b54-a0f3-4c1a-8f0b-a24ac42f3bb9'] {{(pid=83885) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:48:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.lockutils [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83885) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:48:07 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073 {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:48:07 devstack sudo[93683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073
Apr 29 08:48:07 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:48:08 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root
Apr 29 08:48:08 devstack cinder-volume[83885]: DEBUG oslo_concurrency.processutils [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc20d80567e24af38e5075f5777d5073" returned: 0 in 0.584s {{(pid=83885) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:48:08 devstack cinder-volume[83885]: DEBUG cinder.manager [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Notifying Schedulers of capabilities ... {{(pid=83885) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:48:08 devstack cinder-volume[83885]: INFO cinder.volume.manager [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Deleted volume successfully.
Apr 29 08:48:08 devstack cinder-volume[83885]: DEBUG cinder.coordination [None req-0fbbf732-bee6-4df1-a64c-5371ed055d7c tempest-CinderUnicodeTest-1768026931 None] Lock "cinder-dfdaaded-ac55-43a1-8b6c-266fe0e0bf10-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=83885) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:48:17 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=169,cinder:SELECT=109,cinder:DELETE=12,cinder:INSERT=39 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:48:18 devstack cinder-volume[83885]: DEBUG dbcounter [-] [83885] Writing DB stats cinder:UPDATE=157,cinder:DELETE=13,cinder:SELECT=107,cinder:INSERT=42 {{(pid=83885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}